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HEARINGS ON REAUTHORIZATION OF THE 
VOCATIONAL EDUCATION ACT OF 1963 

Part 10: Vocational Education Data System 

< - 

THURSDAY, DECEMBER 10, }981 

House -og Representatives, Subcommittee on Elemen- 
tary, Secondary, .and Vocational Education, Com- 
.mittee on Education and Labor, 

, , Washington, D.C.- 

9iSV U t° mn £ ttee ™k pursuant - to call,"" at -9:40 a.m., in room 
~?f! r f2 buri ^ 0us ^ 0ffi C&ilding, rHoir. Carl D v PerkinJtchS? 
mart of the subcommittee) pressing grains i.cnair 

Members present: Represenfc&ves^Perkins, Craig, and Erdahl. 
leSiv P e r SkiL°t hn J W C ° UnSeI ' and Na W L Kober, 

Chairman Perkins. The/Subcemmittee on Elementary Second-' 
ary, and Vocational Education is continuing hearings to£yS the 
reauthorization of the Vocational Education Act ' Y 

iS^SS^^&l 0 ^ °, n ^ -^education 
-J?!! Edu /! atio " Amendments of 1976 mandated the development 
TW^^T ? a nat * onaI Vocational Education Data System 
rw£* ^55 ° f ^ ucat101 ? and the Administrator of the National 
Center for Education Statistics were-jointly chareed with the rpl 
sponsibility for developing fhis system / 7 g W the re "~ 

studen^ W nr^ eS that this system shail ™ lude information on 
S^^^reT^ completers and leavers, staff, facili- 

In mandating this 'system Congress was responding to 1 a lack of 
adequate data to judge program effectiveness and to make impor- » 
tant decisions about future directions mp0 * 
the testimony today we hope to gainjm understanding 

currently providing, and problems encountered in its development 
and operation. We would also like to know the cost, in doffi S 
person-hours of generating this data, as well as any refcommendl 

^ T ****** Federal Sal 
I believe our-objective ought to Jbe to reduce the data collection to 
the absolute minimum while securing enough data to hold adminia 
trators accountable for the use of public funds.? admims- 

onSX Ut £ b S 0n A' * g T g *? put these witnesses on all at 
once. Dr. Senese, Assistant Secretary, Office of Educational Re- 
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search and Improvement, U.S.. Department of Education, accompa- 
nied by Dr. Robert Morgan, Director, Vocational Systems Section, 
System De&ign and Analysis Branch, U.S. Department of Educa- 
tion; Mr Donald F. Averill, vice chancellor for vocational education 
and planning, Coast Community College District, Calif« arid chair- 
man, California Community and Junior College Association; and 
Dr. James Lee Harris, representing the American Vocational Asso- v 
* ciation. 

I am delighted to welcome all you gentlemen here this morning, 
and we will hear'from Dr. Senese first. 
Identify yourselves, all of you, for the record. % . , 

STATEMENT OF DONALD SENESE, ASSISTANT SECRETARY^ 
OFFICE OF EDUCATIONAL RESEARCH AND IMPROVEMENT, U.S. 
DEPARTMENT OF^EDUCATlON ^ 

* Dr. Senese. Mr. Chairman, members of the subcommittee. 

I am pleased to provide testimony on the development and oper- 
ation of the- national Vocational Education Data Systems [VJSDS], • 
operated by one of the components in my office, the National , 
Center for. Education Statistics [NC^S]. I am accompanied by Dr. 
Frank Corpgan, Director oFliie Division of Postsecondary Educa- 
tion Statistics and Dr. Robert L. Morgan, VEDS Section ctlief of 
NCES. * 

In addition I would like to submit a more extensive treatment of 
several of your questions undpr separate cover, prepared by NCES. 

I would like to talk just very briefly on the history of VEDS. The 
creation of VEDS* was mandated in Public Law 94-482, section 
I61(aX as part of the^ Education Amendments; of 1976. Jhe law 
called for NCES to develop, implement,' -and operate a national vo- 
cational education data system. • ■ 

Th^specific questions to be -answered by the VocationakEduca- 
tion Data System were: 1 \ 

Who is beiijg served in" vocational education programs? 
A * What are they being served? 

What is being accomplished? and \ 

What is the dost? * r 

Under this broadly ^defined congressional mandate NCES devel- 
* oped a comprehensive and complex system to sfuHy vocational edu- 
cation hrthe 50 States, the District of Columbia, and thfcee outlying 
areps on an annual basis. " 

In developing the VEDS system, NCES consulted extensively 
with other Federal agencies, State agencies, postsecondary institu- 
tions, professional associations, and other interested groups. 

(The first yean of reporting was 1978-79. The tfcird year, 1980-81 
collection is being reported to NCES this month. 

The primary purpose of VEDS is to provide a national reporting^ 
and* accountability system to generate 'uniform data from the 
States to support the decisionmaking activities of CoiSgress with re- 
spec^ to the establishment of vocational education policies. 

As far as the information currently contained in VEDS section 
161(a) specifics that YEDS is, to provide information on vocational: 
first, students, including' their race and sex; second, programs; 
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third, program completers and leavers; fourth, staff; fifth, facilities- 
and sixth, expenditures. 

VEDS currently contains information elements representing 
each of these areas except facilities. It was found that data on facil- 
ities are very stable, and that a recent study could meet the VEDS 
' requirement for some time to come. 

Section l'61(a) also specifies that program evaluations to be con- 
d £™ by J he S ^, tes u T n der section 112(b) are to be contained in the 
VbDb system. Thus VEDS contains information concerning the 
extent to which program- completers and leavers find employment 
in occupations related to their training. • • . 

There are departmental vocational education data collections 
other than VEDS. In recent years the Office of Civil Rights, the 
•Office of Planning, Budget, and Evaluation, the National Institute 
of Education, the Office of Special Education and Rehabilitation 
Services, and the Office of Vocational and Adult Education [OVAE] 
all have undertaken or maintained major collections of vocational 
• education data VEDS, however, was specifically designed to be the 
prime source of vocational education data, largely subsuming these 
other collections. . 6 

.. NCES, als o conducts thre e major related pfW-gi^ 0 - SttF ^ey- of 

noncollegiate postsecondary education, the higher education gener- 
<. studies SUrV6y ° r HEGIS ' • and the nations 1 longitudinal 

The> first, tKe purvey of noncollegiate postsecopdary education, 
_^pFOvides information on degrees for a category of postsecondary in- 
stitutions that are generally not included in the State vocational 
. education plan. These data then can be merged with VEDS' State 
plan coverage. 

The second study— HEGIS— deals largely with a populatipn of 
schools for which there is a considerable overlap with the VEDS 
population. 

The third, the national longitudinal studies, provides outcome 
data lor a limited subset of students which can enrich the VEDS 
•lollowup findings. 

Particularly with regard to HEGIS, NCES acknowledges that 
there is a degree of duplication in these studies. However, NCES is 
developing a new unified-system for school years 1982-83 which 
will simplify and consolidate HEGIS and VEDS reporting. ■ 

As far as the cost and burden of VEDS to the States it must be 
™ o the outset that the data on this subject are relatively soft. 
, NOEb has conducted a pilot study with eight States in an effort 
to develop a methodology for estimating cost and burden. Thisf 
study provided results of only limited applicability to other States, 
butthese estimates are the only ones available. 

The total national* estimated costs were as follows: Start-up costs 
over an average 3-year start-up period, $10 to $35 million; anfcual 
> 0pfJ i r onnS costs .' * 45 to $ 55 mi l"on; and annual person time, 1,000 
to 1,300 person-years-including estimates of local school district, 
institutional, and individual time. * • 

In evaluating these costs two factors should be taken into ac- ' 
count. '■ T 

First, one of the most* difficult problems was that of attributing 
particular costs of VEDS when facilities and personnel were shared 
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* with* other operations. Data collected during the study suggested* 
y/ that 3ome States tended to overattribute costs to VEDS. 

Second, as individual States mature in their data collection and 
processing capabilities, operating costs may be reduced. 
, As far as the Federal costs to establish and operate the VEDS 
program, costs incurred by NCES in the development and estab- 
lishment of, VEDS for the period from October 1976 through the 
end of fiscal year 1981 total approximately $3.5 million, with an ad- 
ditional $1.5 million spent for salaries. Half of the $3.5 million has 
been given directly to the States in the form of competitive capac- 
ity building grants. v 

VliDS represents a major effort by tHe Congress to insure more 
comprehensive, accurate, and reliable data-about an area of Ameri- 
can education which receives significant financial support from 
both the State and local levels. 

VEDS, however, has encountered a variety of problems during its 
development, implementation, and operation. These problems have 
compelled the Department of Education to take a serious look- at 
the VEDS system. ^ 

Th e first class of problem s which were _eacQuntered_during_the 
"developmental period concerned establishing thte scope of the 
system. What institutions and programs could and should be stud- 
ied? , r 

NCES used the legislative mandate as the guiding framework. 
Only data which N.CES decided could be reported by the States 
with reasonable "accuracy would be included. In addition, the cur- 
rent system contains limited target group data beyond tnat directly 
mandated by the law. 

A continuing controversy exists regarding the inclusion of non- 
State plan institutions in the VEDS d£ta collection effort. N 

A second, definitional problems. 

For the purpose of developing VEDS^it was necessary to reach 
agreement as to the technical meaning of many vocational educa- 
tion, terms. NCES, in cooperation with the States has attempted to 
clear up many of the misunderstandings concerning definition of 
terms. 

However, 'problems still do exist in this area. For example, terms 
such as disadvantaged, limited English proficiency, handicapped, 
and related placement have been defined differently by various 
States, leading to data collection problems and incorrect data re- 
porting. • - , 

NCES is continuing to work with the States on remaining defini- 
tional problems, although solutions are not apparent in all cases. 

A third aspect: Cost and burden faced by the States. ^ » 

The issue of cost and burden has been a major complaint about 
VEDS. Many States argue that to fulfill all the VEDS data require- 
ments puts a heavy drain on their budgets, particularly in a time 
of fiscal austerity* # 

NCES has been sensitive to*these concerns. Through capacity 
grants to Statls, a reduction in data^ elements, and training and 
technical assistance, NCES ha§ tried £b alleviate the burden. HoW- 
ever costs and burden remain a major concern to all the respond- 
ents as well as to the Department. 

Fourth. Respondent problems. t 



It was recognwed early that for a variety of reasons some States 
literally could not come into full compliance with the legal man- 
systems 1 * 40 ° f sopRistication of their existing data 

Working with the Office of the General Counsel, NCES developed*' ■ 
regulations formalizing the concept of substantial compliance with 
frtL wherein these States could supply substantial 
amounts o^the required data along with remediation plans show- 
ing how they would come into full compliance within a reasonable 
period ottime. 

Wwejt not for the creation of the substantial compliance catego- 

pHn^lTf tW ^" thl ?3i 0 L the res P° nd ents would have had vocational 
educatiotffunds withheld in school year 1978-79. 
And fifth, administrative problems. ' 

• There have been internal administration and data processing 
problems in NCES. These included forms design .and the tim! ■ 

• period from data collection to publication. ' 
^elr W Sl-8? t6 COmment on d at a colle ctio n plans for the school 

Now that 2 years of data have .been collected NCES has beeun an - 
indepth review of .VEDS.- V Degun an 

In order to reduce the large cost and burden of VEDS while ad- 

Sm^? 6 ??Pt s £ nal ^^date' NCES has recently worked 
with OVAE and the Office of the General Counsel.'as well as my 
own office, to curtail the VEDS collection sharply for the next date 
collection year, school year 1981-82. 

In order to do this NCES plans to suspend, several areas of the 
data collection which have been most burdensome to the States or 
least rehab e in the data base. The States were notified of these ^ 
changes by letter on November 3. 

The suspensions are as follows: 

D f ?M»A S} iV?u t , he , Col I^ ti ° h ? f teacher/staff data: These data are 
stable due to the lack of staff changes from year to, year " 

Second. Suspend the collection of employer, fqikfwup data: These 
data also change very little from year to year 
H^SA"? 6 /" 1 , the C ? H ^ ti01 ? of P^am leaver and foltowup 
IL Sf I d / te A l tu exh u$ - a low retu l n rate and are expensive 
daL Xfin^ ^ the collection of certain enrollment -and finance 
tio?o?tf 1 "I pro ?^ ms ln * he s P eci al needs areas make collec- r 
H^ffi^i^ 18 en , rol f lmeflt d .ata difficult; some finance data which was 

• Uitticult to collect was suspended. 

We estimate these changes, this coming-year, will reduce the ' 

So:KnXlty ely 48 PerC6nt ' fr ° m 198 '° 00 K ° UrS t0 about ' 
Thafik you. , 

[Material submitted by Dr. Senese fallows:] * 
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This Information Is Intended to supplement the testimony presented on the f 
development and operation of the Vocational Education Data System (VEDS) 
presented by Donald J. Senese, Assistant Secretary for Educational Research 
and Improvement, Dr. Frank Corrlgan, Acting Assistant Administrator, Division 
of Postsec^ndary and Vocational Education Statistics, and Robert L. Morgan, 
Director, Vocational Education Data System, National Center for Education 
Statistics, before the Subcommittee on Elementary, Secondary an<f Vocational 
Education of the Committee on Education and Labor of the House of Representa- 
tives. Specifically, this paper provides (a) a chronological* history of the 
development of VEDS, and (b) a description of the types of data collected 
by-VEDSr- «. — 



As authorized by, P. I. 94-482, the primary purpose of the Vocati^al Education 

Data System (VEDS) is to provide a national reporting system to generate 

uniform data f'rom the States to support the decision-making activities of * T 

■j 

Congress with respect to the establishment of vocational education policies. 
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HISTORICAL BACKGROUND t 

On October lg, 1976, the^Education Amendments of 1-976 became law. House Report 
94-1085 and the House Hearings on HR T 94-19 constitute the- legislative history 
upon which the development"*^" the data system Is based. Volume I of these \ 
hearings presented the full re>ott of the GAo' study of vocational education 
completed the previous year. The GAO report criticized the Administration for 
•failure to require sufficient data to monitor State planning and state eapendl- 
Uires of Federal funds. Among os£**- C oncerns expressed, it wa^ concluded that 
better labor market data were needed, thatj Improved follow-up data were needed, 
and that data were needed on both race and sex of program participants and 
completers. Throughout the hearings*, numerous references were made to the lack 
of appropriate and comparable data across Statcs^on Vocational Education. 



The specific questions to be answered by the vocational education data system 
according to the legislative history are: "Who Is beln§ served In vocational 
education programs' 1 What are they being served' What Is t>elng accomplished? 
And what Is fhe cost?" * 

Section 161(a> of p.U 94-482 required that "the Commissioner a^the 
Adalnlstwtor of the National Center for Education Statistics jointly develop 
Information elements and uniform definitions for a national vocational education 
^daxa reporting and accountlrrg system. This system .shall include Information 
resulting from the evaluations required to be conduct 'by 112(b) ... and other 
Information on vocational^) Students, .B) programs, C) Program completers and 
leavers, D) Staff, E) Facilities, and F) Expenditures." Congress required that 
the -system be, compatible with the Occupation Information System (Section 161(b)) 
and with the Comprehensive tmployment and Training Act data system. Congress 
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also required that any Sttte receiving Federal assistance supply°information 

required by the Administrator and comply lr\. its reports with the Information 

elements snd definitions prescribed. ° 
.» • • 

Based on the legislative history, NCES and Bureau of Occupational snd* Adult 
Education (BOAE) staff aet to begin the development of Information elements 
and uniform definitions to be utilized In reporting 'on vocational education* 
On October 19, 1976, a central planning committee was formed- to set strategies 
and to determine resource needs*. Both NCES and BOAE began to Identify potential 

, 

user groups and collection overlaps with existing surveys. 

, > <. 

The central planning committee met and agreed that four task forces should be, 

formed to develop specific positions of topics of concern. These were: 

A) System Design, B) Completer/Leaver and Employer Follow-up, C) Definitions, 

and D) Bilingual Education. Each task force met In December with a broad , 

representation of Federal and State interests represented. Position papers 

* were prepared and reviewed by NCES and BOAE staff. Because of the high degree 

of overlap, the task forces were combtnjra. " 

v v _ < 

On January 12-14, 1977 over, 50 Federal and State agency representatives met In 

general session. At this meeting there was extensile State Involvement and many 

special Interests were Identified. * For example, the Office for Civil Rights (OCR) 

expressed Interest ih^-Staff Racial/Ethnic by sex, data at the slx-dlglt^ , program* # 

level of specificity* BOAE expressed interest in student ^Jata at the same level 

•a£ specificity* 0MB expressed interest In careful exaalnatlon of other data 

sources^ to assure that no data being collected were. redundant and that all 

. relevant sources were utilized, as well as concern that the facilities area fre 
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* refined or culled. Several groups, both State and Federal', expressed Interest 
in a.asuring that special target groups (e.g. handicapped) be identified by 

'-'both the handicapping condition and vocational education aervices provided. 
ttany'States' expressed interest* in assuring that the dat* system have capacity 
for fulfilling evaluation and accountability requirements under P.L. 94-482. 
The Department of Labor expressed a need for high quality supply data from 
the vocational education sector-to fulfill the National Occupation Information 
Coordinating Committee's (NOICC's) requirement for supply estimations. There 

was concern about Just what information must'b"e gathered by "labor market 

J 

t area," as well as the def inition' of that term. , 

* 1 « , 

i Timing and interferes Vith other data systems were discussed. States clearly 
indicated fchat considerable lead time was needed to establish a reliable, 
accurate system. States expressed concern about interface, between Section 437* _ 
General Education Provisions. Act (GEPA) and P.L. 94-142 (Special education) 
data systems. The issue of; whether or not adult enrollments, were to be 

( separately accounted for and how consumed a large-amount of time. 

The linkage l&tween program data and occupational data was discussed. Problems > 
related to Handbook VI Standard terminology for Curriculum and Instruction In 
Local and State School Systems and HECIS Taxonomies Of Instructional p'rogramS 
when applied to manpower planning were, cited. , Finally, ano'tfter recurring Ques- 
tion emerged, the*sampling unit and reporting unit for the Federal reporting. 
The group was about evenly divided among those who felt that the vocational 
data system should collect data by 1) eligible recipient, 2) labor market area, 
«tyi 3) state aggregate. At this point the concept of reporting versul record 

*Now referred to as Section 406(a) ' 
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keeping emerged. That Is, data at the local level would need to be somewhat 
more specific than that submitted to the Federal level In order to assare 
accurate tub-State labor supply Information. The January meeting Identified' 
most of the major Issues that were to be addressed In the development of the 
vocational data system. Also, this meeting reinforced the Importance of'State 
Input In all developmental activities. 

Due to the large number of questions concerning Congressional Intent , a meeting 
was held-b^wecn Congressional Committee counsels and NCES staff* One proposi- 
tion advanced by the counsels was that all public vocational education should 
be Included In' the State Plan and that the notion of two distinct universes,, > 
State Plan versus all vocational education, was not the Congress' Intent. Rather 
It was noted that the Congress Intended that all publicly supported vocational 
education should be covered by t*he State Plan. 

As a result of the meeting between Congressional and Department st&tf , 
Mr. Perkins, chairman of the authorization committee, sent a letter to the 
Administrator of NCES^that granted a one-year delay In Implementing the VEDS 
data collection activity and enumerated three condt^ons pursuant to the granting 
of that extension. These were: I) full Implementation by FY-79, 2) that the extra 
year be utilized In systems design, and 3) that every effort be made to Interface 
with the CETA data system to achieve a "hand In glove" fit. 

A review of other Federal agency collections was conducted. Bureau of Education 
for the Handicapped (BEH) and NCES sfaff^met to determine the interfaces 
between P.L. 9^142 and P.L. 94-482. It was agreeid, for example, that VEDS 



would collect the data required for monitoring P.L. 94-142 and that handicapped 
status would be based on Individual Education Plans (IEP's) at the elementary 

x . - i 
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•nd secondary levels. NCES and Veterans Administration staff met to determine 
it data^ collection of student follow-up information could be coordinated* At 
that tine, after a series of meetings it was believed that far too many 
differences existed in the two laws to permit a common collection* 

Meetings were held between CETA staff and NCES staff to determine the degree of 

consistency between the two data bases* Numerous differences were- identified, 

especially in the recordkeeping a nd financial accounting areas. Even greater 

differences were seen JLn definitions in law. The primary reason for the 

differences was the high level of emphasis 'placed on public service employment 

'by CETA and emphasis' placed orf occupational preparation by vocational education. 
« * 

NCES, BOA£, and Office of Planning, Budget, and Evaluation staff met to discuss 

the overlap among Sedtion 437' o/ GEPA; Section 108 and 161(a) of P.L. 94-482. 

Careful examination of the provisions of each mandate clearly indicated that 

overlap was inherent in the legislation ajid that there was no legal basis for 

not collecting the data specified in each of these sections. It was agreed 

that every effort would be made to avoid duplication, bujt that legislative 

intervention would be necessary to clarify the roles of each unit with respect 

to these collection efforts. Finally, several internal NCES meetings were held 

y° n financial reporting! enrollment reporting, and staff reporting, and every 

effort was made to assure compatibility among survey terminology although 

this was tro^t always technically feasible. 

* > 

In March, two .series of meetings began. The VEDS planning task force was 

formed and began meeting on March 4, 1977 on a weekly basis until May 25, 1978. 

The purpose of this task force was to develop uniform definitions for required 
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data element* and to reaolve issue* between agencies on reporting requirements 

and record keeping requirements. Several staff from the National Center for ? 
i 

Education Statistics (NCZS), Bureau of Occupational and Adult Education/ 
Associate Commissioner for Occupational Planning (BOAE/ACOP), Bureau of 
Occupational and Adult Education/Of f Ice of Planning (BOAE/OP), Bureau of 
Occupational and Adult Education/Division of Vocational and Technical Education 
(BOAE/DVTE), Office of Planning, Budget and Evaluation (OPBE) , Bure.au of 
Education for the Handicapped (BEH), Office for Civil Rights (OCR), National 

Qccupatlon Information Coordinating Committee (NOICC), Department of Labor/ 

f / • 

Employment Training Administration (DOL/ETA) and National Institute for 

Education (NIE), participated in the meetings. 

On March 15, 1977, the first of a protracted series of Committee on Evaluation 
and Information Systems (CEIS - a committee of the CounciL^ of Chief State 
School Officers) vocational task force meetings began.. This series of meetings 
focused on the data requirements of P.E. 94-482 in terms of both data burden 
and the ability of States to provide accurate, reliable data. This group 
provided Input on 1 ) other related collections; 2) current collection practices 

in States; 3) conceptual Input on systems design; and 4) State concerns about 

* s 
data burden. « 

A feasibility study was recommended in selected States to test the capacity 
of States to obtain reliable, accurate data for local education agencies and 
postsecondary Institutions using the applicable data elements and definitions. 
Also, this study could provide empirical Information on the costs of data 
acquisition both In terms of manpower and^dollars. The remainder of the spring 
and summer was spent in developing and refining definitions and reporting % 
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font to be tested in the feasibility .judiea incorporating input. 



..During June % «nd July 1977, the rather complex federal forms clearance process 
for the feasibility study began. During August and September feasibility 
*tudy contracts were let. The selection of Syte. to participate in the 
feasibility study was based in part on ah attempt to represent the range of 
* reporting abilities? The reasibility stu'dy was separated into three components. 

They were: Educational Process ^Educational Impact; and Educational Finance. 
, ^Within each component being tested, one State-wa's selected that^ at least, in 
theory, had current capacity to provide required data, one State'vhich presently 
reported inability to provide such data and one State which "had innovative 
solutions to data collection which were not fully, implemented. 

- \ 

The participating States by component were> Colorado, Illinois and Texas - 
the education process component; Colorado* Minnesota and Pennsylvania - the 
education impact component; and Calif o X nia; Oklahoma and Utah the educational 
finance component.' Wisconsin conducted the studying all three components . 
at State expense.* , . '*S V - 

Even though the feasibility study's scope Sf work was very detailed, 
operational questions raised by the participating States made it clear that 
^ter-State coordination was essential if Compatible results were tf 
^ achieved. For that reason, a series of meetings were held to assure coord- 
^ ination. It was apparent that many operational definitions and decisions 
were necessary to actually implement the data collection at the rSCsi-*evel. 
Over a period of three months each form was restructured and refined. 
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On reviewing the results of the feasibility study, the States recommended 
that only data that closely approximated the BOAE collection, which was to 
be tuppl»nte<{ by VEDS, be requested for 1978-79 and that NCES develop the 

forms for*the collection such that data for 1979-80 be made voluntary. By 

< ' J 

approaching the problem In th£s manner, It was contended fnat States would 

not be forced to report Inaccurate data and that States could provide substan- 
tive reasons for not providing voluntary data thereby Identifying areas where 
V 

technical assistance Is needed. Based on these findings NCES staff once 
again revised the forms* C" 

The first public meeting on the^revlsed forms was held In Washington, D.C., 
May f V l]p78 at the State Directors of Vocational Education conference. The 
primary concern of this group was the funding for Implementation rather than 
the .data per se . 




The second public meeting produce^ ^pre technical comme^O^ This occurred 

at the American Vocational Information Association (AVIA) , May 23-25, 1978, 

In Oklahoma Qlty. Forty-one States were represented at the meeting with 

over 100 participants. Most of the people In attendance were directly p 

• Involved with the actual data collection within the States. The recurring > 

concern of the meeting was how data could be obtained on the public sector 

of Vocational Education ndt oov6re6**by the State Plan. ^It was the opinion 

of almost all States In attendance that the data, other than State data, 

could be obtained on vocational programs covered by the State Plan, but It 

was \he clear consensus of the group that'the Vocational Education Agencies 
« k 

could not provide even accurate estimates of data not covered by the State 

\ 

Plan. . 
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U should be noted yatfeat State, had p « ,uhllc w^m...., 

education noV covered by the Statft p1 ,„_ State8 reeom , nHpH th . t Ne£s gon . 
duct a separate 8tudy t0 detrra ^ r for eaeh ^ ^ geetof 

• "y th « State Plan, and th.t other collection nro..„.^ s be dw1aBM , ^ 
collect that data. There w ere concern, about the of the f . elm< .. 

report and evaluations req„1redM>v Section m, b )(l)(.) of >.i.. 94^82, both 
of which are po stponed Indefinitely, 



1 



The Staff form, however, was the DO st serious concern In terms of the technical 
abilities of States to provide accurate data. Full-time Equivalent (PTE) 
calculations were not standardized In terms of the denominator. The partlclpat 
log States wanted clear standardization of the computations such that standard 
data would' be available. They fended that 500 contact hours be adopted, 
for postsecondary Institutions and 1000 contact hours be utilized, for the • # « 
secondary level as standard denominator's In PTE calculations. A few States \ 
questioned the need for slx-dlglt precision In Staff data for FTE. 

Other concerns were: .1) that the varlable senary grade level definition 
for program enrollment be standardised to grades' il Ymd 12 for Jart A; 2) that 
Consumer and Homemaklng be divided l„to slx-dlglt Handbook V! categories; and 
3) special „ ee ds definition be further refined..' As a 'result of thls.meetlng, 
all forms were revised b y NCBS staff. ; " * 

NCES, as part of the technical assistance to States, began a series of four' 
5-day regional workshops beginning In October 1978. Bot h lecturt and demonstra- 
tion were utilized to assure that personnel from each State fully 'understood 



the reporting requirements of the data system. 
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As * result of this workshop', it became ^uite clear that the implementation 
of VEDS required not merely a modification of* existing data collection systems, 
but in most States a total development effort starting from "ground zero." 
Mor* specifically, many States ' representatives freely admitted that they had 
been providing at best, estimated data on unduplicated counts of enrolment 
and completers t subjective data on follow-up outcomes, and crude estimates of 
Staff assignments . Without doubt » the financial area was the least developed 
of the current data components . Accounting for funds by legislative purpose 
revenue was beyond the capacity of most States, for non-Federal funds. 

Further, it was found that the within-State governance structures' were much 
more important in establishing a uniform reporting .structure than previously 
thought. In States that had strong centralized governance structures, the 
implementation was straightforward. However, in % States where some vocational 
education activities were delegated to agencies not directly reporting to the 
State Board for Vocational Education (e.g. community colleges or secondary 
education), the integration of the data requirements generated far greater 
difficulty. In many States, interagency communication was^not very effective 



as evidenced by the fact that many participants ha'd never seen the VEDS forms ^ ^ 
prior to the workshops. * ^ 



Beginning in March 1979, Presidents of Junior and community colleges initiated 

a major effort to impact the; VEDS requirements for 1978-79. Among the problems 
* 

» identified wera: staff FTE calculation; identification of leavers; identifica- 
tion of persons who corapletej'at least SOX of their programs; cost/benefit, of. 
participation in the Federal program; Veterans Administration requirements for 
student foilow-up; financial accounting; and postsecondary program definition. 
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A .erie. of —tin,, were held to dl.cu.s the.. .„d other !..»«, ulth represen- 
tative, of the post.econdery ..ctor beginning Ih May of 1979. These meetings 
led to .structuring of th^VEDSd.t. collection for 1979-80 ,„ d forward lnt0 
1) elementary-secondary; 2) fcsfendary reglon.lly accredited institutions; ' 

3) postsecondary Institutions .not regionally accredited (State-approved); and 

4) postsecondary vocational offerings in elementary-secondary institutional, 
settings (other postsecondary). 

Most of the postsecondary Institutions contended that data normally flowed ln 
these four streams and that the Quality of the data would in Uct be Improved 
If each state submitted data ln this format. 

' " * 

Responses to some of the issues raised by" the postsecondary community led 
NCES to conclude that staff PTE by assignment had so many technical flaws ■ . 
that it should not be utilized at any-level. Overlap between Veterans Admin-. " 
• istr.tlon and VEDS data collections was cited, but had been mainly resolved.' 
Financial accounting problems were partially solved through legislative action! 
The postsecondary/adult program deflation was no longer a major concern 
because of the change made in the level definitions. Perhaps the largest gain ' 
from the Interaction with the representatives of postsecondary Institutions wa<P 
surfacing the overlap between .VEDS and the HEG1S earned degree reporting. 
This has been addressed and will be finally solved ln 1982-83 reputing. 

The^CMS Vocational Education Task Force, as a result of'the Sprl„g 1979 meeting, 
began to develop a position paper on VEDS. Implicitly this paper endorsed the 
1978-79 collection methodology and the notion of a centralized' data syst'eni 
similar to VEDS housed in NCES. This paper specifically identified issues and - 
problems remaining wijj, the proposed 1979-80 VEDS instruments and techniques. 
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At thtf San Antonio annual meeting of CEIS, October 22-25, 1979* NCES presented u 

t <* , f 

Its position In response to the CEIS paper to the Vocational ^Education task 

force. All parties recognized that NCES had met the great majority of CEIS 0 

expressed concerns In the position paper* Even those persons who spoke against 

recoamendlng VEDS noted that NCES had been very re^nslve tofiCCSSO* task force, 

HoweVer, 'SEAs c la lop? that VEDS set a precedent for student unit accounting 

which could nVt be endorsed. Those speaking ^on behalf of recommencing VEDS , 

noted*burden reduction In other collections, replacement of other^irveys and 

unlfor\.datto definitions as reasons for support. 

Thus for the 1979-80 school year the postsecondary collection was placed In so- „ 
called "streams" or separate categories and nuxrerous minor changes were made 
based on issues raised by the postsecondary community.,- In addition, a few minor 
changes were made In the secondary sector. Modified forms incorporating these 

I • * . '. 

changes were submitted to FEDAC with a request for a three-year clearance In 

1 * t 

order to assure system stability over time.* In keeping with this clearance, 

th/ 1980-81 data collection employed Jorms essentially Identical to those used 

^ * ? * 

in 1979-80. 

• >• 
t 

With respect to developments in progress for the current reporttag^josar 
(1981-82), the reporting requirements for VEDS have been car«£&il^ reviewed 
based on data submitted by the States In the first two years* of^the syAfera. 

Several required Information Items have produced extremely soft data, and have 

' t 

been unduly burdensome to States as well* Several meetings have been held wlth{ 
k CEIS and with the Postsecondary Task Forces to determine how best to approach 
problems that have been revealed in three areas: special needs; leaver. \ < 
follow-up; and employer follo#-up. , ^ 

4 *» ' • 
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A, a re.ult of thl.'work, it has been suggested that a temporary suspension of 
etrt«U ittu would be .in the bestfinterest StTates and the Federal'governaent . 
^ Between January, 1981 and November, 198!. OERI/NCES and OVAE jointly worke'd with 
the Office of General 'Countel and other Department of Education staff to assure 
that data suspensions could be legally permissible. On Novem^r 23, 1981, 
Executive-Officers of the Sole Boards of Vocational Education were notified of 
certain Suspensions, which are presented in the following table. "In addition, 
in 1982-*p, NCES' new unified program taxonomy (which has been developed in 
collaboration* wfth the states) will, be used to provide amplified program rf ub 
and to consolidate HEGIS and VEDS reporting. 
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THE TYPES OF DATA COLLECTED 

Table 1 presents by year of collection the data collected by VEDS, from the flrat 
* 

collection completed for the 1978-79 school year until the expiration date for the 

J 

.Current authorization. In both 1979-80 and 1980-81 school years, al>data contained 
In the system were collected. For subsequent school years the specjAl needs data, 
leaver follow-up and employer follow-up have been suspended while NCES further 
assesses the methodology for collecting these types of data. 



Foro and Section Titles 






School 


Years 






Secondary ProRran^Enrbllment 


. 78-79 


79-80 


80-81 


81-82 


* 

82-83 t 


33-84 


* * • 

Pft^p A — dr 1 ^ C * /» 4 f 4 m 

Total Enrollment 


X 


X 


X 


' X 


X 


X 


P> f i j^flVt Kn< f T\»mi o mr\A Cjv • 
MbL«l/ Lllllllk I/C91K* • IIU 9CX * 


X — 


x 


x 


X 




X 


Srrffeial Need* 




x 


x 








Program Completers 


x 


x 


x 


X 


X 


X 


Part^.- Other Voc. Ed. 
Total Enrollment 




x 


x 


X 


X 


X 


Rac 1 a 1 /Ethni c Desig. and Sex 


— Hb- 


x " 


x 




X 


X 


Special Needs r 




X 


X 








Enrollment by Program Level 


x 


x 


x 


X - 


X 


X 


Part C 

Special Needs by Instriff. Setting 




X 


X 


X 


X 


X 


Part D 

Enroll, in Cooperative Voc' Ed. 


X 


X 


X 


X 


X 


X 


Part E 

Participation b.y Legislative Parp. 


X 


X , 


X 


. x 

Work 


X X 
Study Only 


Postsecondary Program Enrollment 








1 






Part A - Occ. Specific 
Total Enrollment 


X 


X 


X 


- X 


X 


X 


Racial/Ethnic Desig. and Sex 


X 


X 


X 


X 


X 


X 


Non-resident Alien 




X 


X 


XXX 
ReRiinv Accred> Only* 


Special Needs \ 




X 


X 








Program vCoapleters 


X ' 


X 


X 


X 


X 


X 


Part B - Other Voc. Ed. 
Total Enrollment * 


X 


X 


X 


X ' 


X 


X 


Racial/Ethnic Desig. and Sex 


X 


X 


X 


X 


X 


X 


Non-resident Alien 




X 


X 


X 

Region. 


X 

Accred. 


X 

ottty. 


Special Needs • 




X 


X 


J 







0 
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Jabla 1 - continued 

\ 

For» and SacMnn t<m — 
« 

Poatatcond ary'profiram Enrollment 
Part C 

Special N«M t by Inatruc. S»ff< 



School Yaara C 
78-79 7^80 » 80-81 81-82 82-83 83- 84 



Part D 



Enrolls In Co-op and Apprcn. 



J 



Participation by Legislative Purp. x\ 
/ - r— L 



X X x 

JJork Study Only 



Tcachcr/Sta ff - Secondary Inst, 
Total S taff 



Teacher/Sta ff - Po^aigcondar^nat. ' 
_ Total Staff f 



R^clal/EthnTTPeslg . Tot/tlT" 
Part-time 



Finance 

* Part A 

Section 1 10 - Setaaldes 



\ X 
1 X 



X >= 



^"*truc. Exp enditure by P rogram 

Part C * ■ 

• Setatldes by Stream* 




•Secondary 

Regionally Accredited 
State Approved 
Other Poataecondary 
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0 

* TaWe continued 








** * 


Form And Section Title* 


78-ft 


79-80 


School Years * • 
80-81 s 81-82 82-83 83-84 


^ .Secondary Cotapleter/Leaver 










Part A(I) 

\ Employment Status of Completers 
by Instructional ProRrao 


•X 


X 


* * 
X X|» 


X x 


Part A(2) 

*X Employment Status of Leavers 
by Instructional ProRrao 


•X 


X 


X 


\ 


» Part B(l) 
• Eoploynent Status of Couple ter a 

by Raclal^thnlc/Sex Designation 




X 


\ 

X X v 


x 


4 Part B(2> 
* Employment Status of Leavers 

S. by Raclal/Ethnlc/Sex DeslRaatlan 




X 


X 




\ Part C(l) , ? . 
Employment Status of Completers 
* by Special Need ' » \ * 




X 


X X 


X x 


Part C(2) V , 11 
Employment Status of Leavkrs 
by Special Need 




X 


X 




• i 

PartD | 
Field of Enployment and Average 
Hourly Salary by Instructional^ 
RjroRram \ 


* 

*X 


X 


X X 
Avr« hour* 


X x 
salary only 


\ *t _i - 

" Post secondary Conjfrleter /Leaver 


• 




■ 


* 


Part A(l) 

\ Employment Status of Completers 
by Instructional ProRrao 


*x 


X 


* 

X 


X x 


Pact A(2) 

^ ^ Employment Status of Leavers 

by Instructional Program r 


*x 


n x 


X 




Part B(l) % 
t Eoployment Status -of Completers 

by Raclal/Ethnlc/Sex DeslRnatlon 




X 


X x 


X x 


Part B(2) 

Employment 'Status of Leavers* 
by Raclal/Ethnlc/Sex DeslRnatlon 





X 


X i 




Part C(l) 

Employment Status pf Completers 
by Special Need 


9 


X 


\ 

X X . 


X X 


Part C(2) 

Employment Status of Leavers 
, by Special Need 


4 


X 


s 


<? 


•Collected but not streamed^ ^ 


( 








\ 

* * 


* 
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Table 1 - continued . 

Form and Se* tl%frritl«a ' , w 

School Ycara 

Po.t.ccondarv Complete r./La^r. ~ 79 ~ 80 8(H » 81 ' 82 82 ~" §3^84 

Part D 

Field of Employment and Average 

Hourly Salary by Inatructlonal * X x t y 

Program *^ ^ X 

Psrt B ~~ m Avg* Hour* Salary only 

Employment Status by Degree 
Conferred v * 



Employer Follow-up - Secondary 

' P«rt A 

Mean of Employer Rating 
by Inatructlona l ProgVam *r 

] Part B 6 — 

Mean Rating* by Racial/ * 
Ethnic/Sex Designation 4 
PartC ~ 



Mean Ratin g by Special Meed 

*«rt D^ 



Mean Rating by Completion 
Status 



Employer Follow-up - Postsecondary 
» 

Part A 

Mean of Employer Rating 
by Instructional Program 
Part B 



Mean Rating by Racial/ 
Ethnic/Sex Designation 
Part C 



•Mean Ra ting by Special Need 
Psrt D 



Mean Rating by Completion \ 
Status * x * 



♦Collected but not streamed* 
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Chairman Perkins. All right, our next witness. 
Go right ahead, Mr. Averill. 

STATEMENT OF DONALD F. AVERILL, VICE CHANCELLOR FOR 
VOCATIONAL EDUCATION AND PLANNING, COAST COMMUNITY 
COLLEGE DISTRICT, CALIFORNIA, AND CHAIRMAN, CALIFOR- 
NIA COMMUNITY AND JUNIOR COLLEGE ASSOCIATION 

Mr. Averill. Mr. Chairman and members of the subcommittee, I 
appreciate this opportunity to present the views of the American 
Association of Community and Junior Colleges orr the Vocational 
Education Data System. 

I am Donald Averill and I am vice chancellor for vocational edu- 
cation and educational planning for the Coast Community College 
District in Costa Mesa, Calif. 

In my testimony, unlike some of the other presenters here today 
I do.representa college district. I do have the primary responsibili- 
ty within that college district for the collection of all college "report- 
ing, data which goes to the State or the Federal Government. How- 
ever," I am not a principal researcher and I have staff that does 
that type of task. So my testimony, to a great degree, is going to 
look at some other variables than those which are administrative 
variables and causing us a considerable amount of difficulty and 
>. concern. 

The State of California several years ago started working very 
closely with NCES about its concerns regarding VEDS, and I can 
report that Dr. Morgan and Kis staff came out to California. We 
sent pgbple back here to Washington, and we spent several weeks 
trying to modify that system and make it more meaningful. A lot 
of that effort has-been reported today. 

I think thai: that has been a positive approach. 

However, there are still a number! of concerns that we in Califor- 
nia have had and the 14 other States that have joined us that are 
not resolved and are substantial problems to us in California. 

I think thfe first and foremost is that you have to look at postsec- 
ondary^education considerably differently than it is either by the 
t act or by VEDS itself. There is a concern that what the act called 
for in measurement and some of the problems of VEDS does exist 
in the act and not in the collection system or the processes in 
which NCES has had to go about implementing the act itself. 

We feel tfcat there nefeds to be a major change in the act itself in 
terms of that data collection system. 

Coast has approximately 38,000 full-time equivalent students in 
three colleges. The average college nationally is approximately 
2,000. full-time equivalent students. We generate, or to generate 
that FTE, full-time equivalent, would require an unduplicated head 
count of 160,000 students or 4.?1 students per full-time equivalent. 

The average college then in the State would have to have 8,400 
enrollment to generate that 2,000 full-time equivalent. 
^ You can see that that type of data base compounds the collection 
* problem tremendously. It makes a totally different type of setting 
than that is faced by a secondary system delivering vocational edu- 
cation. 
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With this range the difference in collection of data will have 
almost uncontrollable ranges of sophistication in how they collect 
and record that data, and that's a major concern to us. 

Wg feel that in California and in most of the community colleges 
throughout this Nation that "if we are going to collect data that 
that data ought to have management applicability ifi the communi- 
ty'college in which it is being collected. 

• If that data is getting back and is being distorted by aggregation, 
by lack of definition in several of the points which were reported 
by our previous speaker, we do not have valuable data information, 
we cannot make wise management decisions or act upon it. 

Both the act and the VEDS requirement of section 112(b) do not 
reflect the changing mission of the community colleges. Fortunate- 
ly reauthorization has discussed new .population needs such as the 
upgrading of skills, economic development efforts, and technologi- 
cal explosion and the role that the community colleges play and 
have played for a long time in implementing these needs. 
_ Co^pnmifry colleges have addressed these needs for years, but 
VEDS doesn t measure this area at all but focuses on the narrower 
scope of entry .Jevel , enrollment. 

California provided for program assessment of its vocational pro- 
grams prior to the VEDS requirements, and I think that one of our 
other speakers today will be addressing this same issue in depth for 
their State. - , 

The California occupational program evaluation system [COPES] 
provides management feedback of data immediately to the colleges, 
resulting in program improvement. 

The student accountability model [SAM] and a longitudinal study 
of that which is being fostered by our district and operated by our 
district provides readily usable information regarding student pop- 
ulations. VEDS actually jias allowed us to use that SAM system for 
portions of the student accbuntability hiodel of VEDS, and it has 
been helpful in bringing some consistency between the two measur- 
ing instruments. 9 \ 

£ State uniform reportirig system now is going into place knd 
will be fully operational in 1981-82. That addresses the broad Vol- 
lege ^factors of students, personnel, facilities and budgets. Factors 
collected on this are uniform and do not vary between the colleges 
because the data elements have been defined for the State. 

However, there is an inconsistency when you compare that data 
back to the VEDS data base and information which is not required 
for the State system and is required pn VEDS. 

VEDS or its counterpart should be compatible with existing sys- 
tems and should provide usable management information to the 
local colleges. f 

The next area that we find a great deal of problem is4n, within 
the employer data base, and fortunately 'today it's been reported 
tngt that is going to be withdrawn from the collection system for 

We feel very strongiy that that type of system is one, in which it 
has been held down to avoid invasion of privacy, it draws on broad 
concepts rather than specifics, and it should make better wide- 
range comparisons. We feel again, that with this particular system 
that it should be statistically accurate, and we feel that possibly 
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the only way to do that is not through a VEDS system but through 
a system similar to a Gallup report-type of survey. 

I support the' need for Congress to determine if it is achieving its 
objectives from Federal funding, .-however the system should not 
* cost more than the amount being" funded. Currently in California, < 
particularly in the coast district, Federal funding for vocational 
education amounts to only 3.2 percent of my total expenditure in 
vocational education. The data should be reliable and valid for both 
Federal purposes and for local management purposes. Obviously, I 
think we have heard already today from the administering agency 
that there are some difficulties with that. 

The data should reflect the vocational enterprise it is«to measure 
and not attempt to compare it to problems with different, and pro- 
gram^ with' different, purposes. And it does not do that, and there • 
has been continuing difficulty with that. N 

The accountability model should address the management infor- 
mation described in the State plan for vocational education which 
could be included in an annual program report to the Federal Gov- 
ernment. We are seeking that type of consistency and asking that 
if we are to be measured that that measurement be meaningful 
and that that measurement have applicability to the management 
of our programs. -o 

Thank you. 9 1 

Chairman Perkins. Than£ you very much. That was excellent ' V 
testimony. 

[The prepared statement of Donald Averill follows:] 

Prepared Statement of Donald Averill, Vice Chancellor for Vocational Edu- 
cation and planning, coast community college district, costa mesa, calif., > 
Chairman, California Community and Junior College Association, Committee 
on Vocational Education on Behalf of American Association of Community 
and Junior Colleges 

Mr. Chairman and Members of the Subcommittee: I appreciate this opportunity to * 
present the views of the American Association of Community and Junior Colleges 
(AACJC) on the Vocational Education Data System. I am Donald Averill, Vice 
Chancellor for Vocational Education and Planning, Coast Community College Dis- 
trict, Costa Mesa, California. 

"It is noteworthy that 54 of 57 States and outlying areas came into compliance 
with the laws and regulations in the first operatioffal year of the system, and that 
we expect similar results for the second year," a quote from a March 1981 letter to 
Senator Hayakawa from Marie Eldridge. I^shudder, my— how the questionable data 
I'm required to provide changes in its journey from my college to the federal gov- 
ernment. I'm astounded at the marvels of data processing. 

Let's review some of the basic problem areas which the Vocational Education 
Data System (VEDS) must address before the vocational education enterprise can .be 
reliably described or judged for its effectiveness. We must address the two basic 
questions posed in the Federal Act, are program completers and leavers finding em- 
ployment in occupations related to their training, and are they considered by their 
employers to be well trained and prepared for employment? 

First, let's discuss what VEDS should do^and does not do. 

1. VEDS should describe accurately and meaningfully the vocational education 
enterprise as it is conducted at the^local college level — which it does not do. 

2. VEDS should collect data which is useful at the local college level for purposes 
i of administration and improvement of programs— which it does not do. 

3. VEDS should answer the basic questions which Congress asks in Section 112(b) 
of the Vocational Education Act- 1 - which it jdoes not do. 

4. VEDS should generate useful data when aggregatedVat the stafe and national 
1 level that are valid for the purposes stated jn Section 112(b)— which it does not do. , 

Secondly, let's discuss some of the basic reasons why VEDS is not useful,«valid 
and in keeping wjth the intentions of the Vocational Education Act as it should be. 
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1. The basic taxonomy problem has not been resolved, nationally or locally. This 
tends to nullify the validity of aggregate data at any level. The incompatibility of 
educational taxonomies with classifications used in industry and labor precludes va- 
lidity of the data for supply and demand purposes. The taxonomy fosters duplication 
2f "TRSSo? an? adds to the local college data burden. Additionally, the incompati- 
ble YEDb definition of programs confounds the collection process. 

2. me attempt «t standardization of national data elements for VEDS has not 
been successful. A prime example is the concept of completers/leavers in California 
community colleges. Definition of programs is another example. 

3. The specificity of data collection often precludes statistical sampling techniques 
at the local college level. Often the .cost is far too high for the benefits^eceived. 

4. The design of VEDS follow-up compounds the errors and, consequently, the in- 
formation is of little value for evaluation and planning purposes. 

5. The required schedule for collecting and reporting data for VEDS is incompati- 
ble with the operations of colleges. VEDS requirements, decisions, mandates, etc., 
are unrealistic in terms of implementing changes in the processes of data collection 
at the college level. Oftentimes, two years is required to make a substantial change 
in data collection. ° 

, 6. The cost of implementing VEDS has been excessive. The indecision, modifica- 
tions and change of signals have been additionally frustrating for all concerned. 

7. Finally, VEDS in California has disrupted a planned process of improving data 
collection from community colleges, which was started prior to the 1976 Vocational 
Education Act. Data collection must be useful and must have the support and com- 
mitment of local colleges if the required objectives are to be achieveU When federal 
fUBfls for vocational education are but a small portion of the total funds expended 
for the vocational education enterprise, local colleges and state agencies must 'have 
a greater voice in the national data collection system. Let's take a fresh look at the 
total problem. 

Conclusions 

We have learned far more about vocational education in California from our 
statewide longitudinal study than from VEDS data. We have confidence in our lon- 
gitudinal data and the process is much more cost effective. 

Standardization of data elements and additional detail should be limited to state 
level management and described in the State Plan for Vocational Education. The 
findings of evaluation studies and summaries of statistical data collection should be 
included in an annual report to the federal government 

Chairman Perkins. Dr. Harris. Go ahead. 

STATEMENT OF JAMES LEE HARRIS, DIRECTOR, COLORADO 
STATE OCCUPATIONAL INFORMATION COORDINATING COM- 
MITTEE, DENVER, COLO, REPRESENTING AMERICAN VOCA- 
TIONAL ASSOCIATION. 

Dr. Harris.. Mr. Chairman, members of the committee, l am 
pleased to be here to speak with you all today on a topic I consider 
very important, thfe Vocational Education Data System or VEDS. 

My name is Jim Harris. I have been a management information 
system supervisor in three States, Kansas, Colorado, a*d Oklahoma 
for 14 years. I recently changed jobs. I am now SOI&C director in 
Colorado. 

I believe that I understand the Issues, many of the issues related 
to VEDS from State and local perspective, and I hope that my tes- 
timony will be ia contribution to you as you make your delibera- 
tions in the future. 

v VEDSig^argobd system but it,is not perfect. There are seven ac- 
tions^that I "believe Congress can take to improve the system and to 
reduce the controversy that, surrounds it. These actions expressed 
as recommendations are ad follows: 

A data use plan should be developed at the Federal level. This 
plan should identify the goals and/or objectives wl^re achievement 
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will be measured. It should identify how achievement will be meas- 
ured and should identify the data necessary for measurement. 

Only the < data that are needed for national decisionmaking 
should be -collected and reported to the Federal Government 
through a basic data system. - ' 

Every data item in the system should Be operationally defined. 
VThe Federal reporting ' systems concerning occupational edtica- 
tito and training should be consolidated into a single system. If 
thik is not accomplished, at a minimum, Federal definitions for var- 
ious\systems should be consistent. 

^re should be funding provided for data system^, 
ates should have the responsibility for collecting data from 
local agencies' and institutions reporting to the Federal Govern- 
ment. 

Sampling or special studies should be used for other special data 
needs not covered in the basic data system. , 

At first glance it seems that there is a lar^fe number of issues 
related to VEDS. My analysis, however, would reveal that there 
are three basic issues: 

No. 1 is the cost of the* data collection. 

No. 2 is the use of the data. *~ 

And No. 3 is the accuracy of the data. *<, 

Cost may be the most critical issue. Stat^and local officials are 
concerned about the use of resources or taking resources^rom stu- 
dent-oriented services to use in the data gathering and reporting 
process. Balanced against this concern is the recognition of the 
need for management information. t ^ 

* And therefore the second m^jor issue evolves from the first 
major iieue, and that is the use of data- Only data, in my opinio^, 
with a clearly specific' and legitimate us? should be reported to 
higher levels of Government. And 'I think, in my mind, acceptable 
use involves the using of data in a predefined s decisionmaking proc- 
ess with actions resulting from the decisions. 

The third ^area or issue Ts^data. accuracy, and obviously if data is 
going to be used for meaningful decisions it should be accurate. 

The cost of VEDS. An examinatiori of the information available 
shows that nobody really knows what VEDS costs. The estimates 
range all over the map from a few dollara a student to $50 or $60 a 
student. 

—An independent systems analyst has told me it can cost between 
$8 and $10 a student, given that the local institutions maintain 
normal data bases used in management at thecal level. 

The Federal share of VEDS costs varies -from State to State. In , 
some States the entire VEDS package would be collected without f 
the Federal mandate. In some States nothing would be collected 
without the Federal mandate.. 

There are several factors which can, and have increased the costs 
of VEDS in the last few years. The first factor is the changing of 
data requirements or definitions. And this, of course, changes sys- 
tems up and down the line from the local institution to the Federal 
Government. 

- The second factor which can increase the cost of VEDSjis the col- 
lection, maintenance and reporting of almost duplicate data ele- 
ments for various Federal reporting systems. And obviously if you 
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are going to report, if you are going, to follow up a student three or 
fou 5.i 1 fff ren , t w „ a y s; the . aaa » student, the local institution can lose 
credibility, the State can lose credibility. , 

K I e ^tIS^S to/ollowup the Veterans'- Administration follow- 
. up, the VEDS followup, and CETA. followups to the same student 
sometimes, it is a problem. 

, A third factor which is associated with high costs' is the sheer 
size of the data- bases which are collected, maintained and reported. 
As you have heard this size is going to be reduced. 

a MM i y State w , e we prepare almost 30,000 entries on 

.the VEDS forms each year, and I might- say that it takes a good 
secretary about 80 hours to type the VEDS reports. 

Use of the data. Ifguess the problem .is that local administrators 
and btete administrators have some questions about the use of the 
date First of all, will it be used? And second of all, if it is used will 
it be used ui a logical manner, recognizing the shortfalls and the 
problems jwitn; date collection and whether the date is strong? 1 

And third, what decisions will be made, from the use of the date? 

And fourth, what actions will Result fronvthe decisions? 

In my State the legislature mandated, the cost-effectiveness 
system, and the cost-effectiveness system evaluates programs on 
the basis ofUhe bang for the dollar, if you will, / T 

' Chairman Perkins. I have to ask that we-snspend ilx about 6 or 
7 minutes, to go over and vote. We will be rightback. Just be at 
ease, all of you, until we, come back. 

[Recess.] 

Chairman Perkins. Go ahead, Dr. Harris, and we will Offish it: 
.Dr. Harris. Thank you, sir. f 
Do you want me to resume wliere I left off? 

DrHARMs*OK UNS YeS ' °° 81163(1 ^ resume your s ^ tement - 

As I said, a date use plan can improve the quality date signifi- 
cantly when people know what the date is going toTe%sed for, and 
I would like to give you an example that is found iri one State, or 
was found in one State. . , 

The State legislature had required a system^ similar to VEDS for 
- over 10 years, and the quality of date had improved initially but 
had reached a plateau. 

In '1978 the State legislature decided that they wanted to have 
evaluated programs and shut programs that were -inefficient so 
that they would have resources to open new programs. And they 
attached a footnote to .the State appropriations bill which required 
a cost effectiveness evaluation S } 

This cost effectiveness evaluation was geared on the key points ' 
in the Federal lawyT&hnk, some of the key points in the Federal 
law at least. It irtvWved Wl per FEE, it involved services to the 
disadvantaged, the handicafi feed, m inorities, it involved sex bal- 
ance, and.it involved tft<ke/ criteria of placement and completion 

In this State there werg-35 programs closed last year and 37 on 
probation and several hundred had been improved, and of course 
new programs had been added to replace those that had been 
closed. One of the neat things about this systeml-was that now ev-- 
erybody makes- a maximum effort to get the data as accurate as 
possible and almost nobody questions the need for accurate date 
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They do, however, question the contents of the formula, and we 
will probably revise the formula this year. ! 

The evaluation process and the associated data system contain 
what many systems analysts feel are the ingredients for a mean- 
ingful management process. 

First, the need for the data way evident. . 

Second, the definitions were clearT^ 

Third, there was a clear decision process for use of the data, a"nd 
Fourtji, action was taken on the decisions that were based on the 
data. 

This is not an appropriate system for the Federal Government, 
but this works very Well in the State. 

Accuracy of the data, of course, as I mentioned earlier, if the 
data is going to be used for meaningful decisions accuracy of the 
data is a very important factor. And decisions based on bad data 
are probably more detrimental to the^public good than decisions 
based on no data. And, without questi^ VEDS has accuracy prob- 
lems. In my opinion they are not monumental or unsolvable prob- 
lems, but they do affect data quality. 

From a strictly head count perspective or gross dollar perspective 
the data improbably very accurate. When a clearly defined variable 
is inserted the data suffers slightly, and as the definitions or the 
difficulty of data, the difficulty of obtaining data increases, the 
quality of data decreases, down to the level when variables on sub- 
jective opinion wh^ch are biased by outside factors or inserted, the 
credibility of the data becomes nonexistent. 

And VEDS has examples of data up and down the line, good and 
bad data. 

A good example of a data iteto which is probably wellreported is 
eivollment by program, in my opinion. That is because States have 
been doing thte type of reporting for many years. .There are, of 
course, problems' in areas of -confusion that 'cause data not to be 
perfect, and I think D<jn Averile has mentioned some of those prob- 
lems, especially at the ^community college level. 

The introduction of level of training confuses the picture slightly, v 
In my State the legislature's definition of a posfsecondary student; 
is not what the Federal definition of a postsecondarv student is, so 
we prepare two different reports, one for the legislature and one 
for the Congress: ( ^ 

A variable like feex of student causes no problem. That is easily 
identifiable by people on the scene and t people doing tire reporting. 

Disadvantaged and handicapped definitions, on the other hand, 
although I believe they are operationally defined in a usable ^ 
manner in VEDS, they are difficult to collect because it Requires 
identification of a student to a bunch of serious processes and time- 
consuming processes. I believe that the data qaalityj^there is not 
what it could be. # 

Expanding thejiandicapped variable to types of handicapped in- 
creases the likelihood of error in the data. And a data item like 
limited Ifoglish/proficiency, the validity of that data is practically 
.nil- It's tbtally'subjective. There is no objective measure at all. It s 
the opinion of somebody, and people are often not willing to make 
adjudgment that the student has a limited English proficiency prob- 
lem. 

0,4 
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' The employer part of VEDS, which is a very, very important con- 

• oept, in my opinion, the data tfiat is reported to VEDS is worthless 
uyen it it s not worthless it is so close that it certainly is not worth 
the money spent. And the reason is that employers are extremely 
reluctant to report poorly on a student. So if they don Y feel that 
the student reflects quality vocational education they don't send us 
a report. / 

In my State for 1979 and 1980, if we can believe the employer 
data were virtually no poorly prepared students, and we 

Know that there had to be because some of our programs weren't 

• what we wanted them to be. • 

In summary, data is expensive and should be. Collected and re- 
ported oriy for an identified use. A data plan at the Federal level 
would be- helpful in two ways. • 

First, it would identify where data is necessary, and 
ttSSr 14 Z demonstrate tfc impbrtance of the information, 
b v^l y u U g6t a , PlanTthftt you are going to use it. 

VMJb should be modified to serve a data use plan 

And for the questions you have on special topics, special topics 
should be covered. That type of data should be covered on a nation- 
have answer many of the questions that you do 

Since the information .for decision should be accurate alf*VEDS 
definitions must be clear, precise and easily usable. If we can't 
define a data Item clearly then we can't collect it 

Duplication of systems, of 3ata items, with slightly different defi- 
nitions, is very expensive. If we c6\ild eliminate duplication of re- 
porting between CETA, HEGIS, VEDS, and so forth, we could savt 
enormous amounts of money at the local and State level. 
„Jt Tf- be sP ec . ific language' in fre 7 Federal legislation 

which funpdata collection. This would- clarify the importance of 
lntormattoh and relieve the pressure on the local and State officials 
S&J*! m u . dSSUme the , responsibilitv for allocating funds tb this 
oriented ser^lce™ 1 ^ P 6 beHeVe t0 be the expense of stu dent- 

*hVv£tl' ?p teS sh0Uld . hav ; e thedata ' reporting responsibility to 
IfcW Go Y e ™ment and the collection from the local schools. 
iJ^l Xbj' 18 lm P° rte nt because if the schools are »port- 
mg to the Federal Government they must also report to thfState 
governments, and this would be a duplication of reporting 
nityto a stak U wS JSf attention ' ( Sir ' and a «? re ciate this opportu- 
[Th£ prepared statement of James Lee Harris follows:] 

fw!£55! ^^ent of TDr. James Lee Harris, D IR ector, Colorado State 
Occupational Information Coordinating Committee (SOICC), DenverVColo. 

« tnnl C ( h a .M f an 'i ( ? 0nimit ^ Members- I am "pleased to be here to speak with you on 
'M«Ehf2f i^lif ^ e "7 ' m P° rtant - the Vocational Education Data System (VEDS? 

M™^- th S 19 ^ 6 Amendments to the 1963 Vocational Education Act 
al Information fW?™?- "J? P re ?t ntl y Director of the Colorado State Occupation- 
Prinr t^ if,iv F^r dmatl T ng ^ m f m ittee. I have held this position for four months 
men £fnrm«?fnn 4 y f ar 1 S* nt f ? urteen l ears ^-«Ccational Education Managei 
ment Information Systems Supervisor in three stites-Oalorado, Kansas- and Okla- 

nlo^I Z vlZ™? ^ ati ° n . al ^ I 01 Education S ^ istics comSefthat ex- 
JS« th J ° na > Education Data System concept in 1977 and the group "that 
conducted feasibility studies in 1978 I have-prepared all reports submitted by Colo^ 
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rado under the VEDS system during the past three years. Finally, I served on the 
Executive Committee of the American Vocational Information Association during 
the years when VEDS was being developed. r H * 

T believe that I understand many of the issues related to data collection in Voca- 
tional Education from a state and local perspective. J hope thafmy testimony will 
be of service to you as you deliberate the reeauthorization 'of the Vocational Educa- 
tion Act in the coming months. „ % 

VEDS is a good system but riot perfiict. There are'seven actions that t I n Delieve 
Congress can take to improve the system and to reduce the" controversy tfiat sur- 
rounds it. Thi?se actions expressed as recommendations are as follows. $ 

RECOMMENDATIONS * 

1. A data use plan should be developed at the.. Federal level, This plan should 
identify the goals and/or objectives where achievement will be ^easured, hotf 
Achievement will be measured, and the data necessaryJbr measurement » 

kOnly data that are needed for national decision making will be ? collected iri the 
bapc data system at the federa)' level. * • 

-3. Every data item in t^e system should be operationally defined. For example^a 
disadvantaged student is operationally defined as a student who qualifies for finan- 
cial aid under an economic need program. * 

4. Federal reporting systems 'cpncerning occupational training activities should Jbe 
consolidated into a single system If this is not accomplished, at a minimum, federal 
requirements for data should be definitional ly consistent across the various federal 
reporting systems. 

5. There should be funding specified for data systems. 

6. States should have the responsibility for collecting data from local agencies and 
institutions and reporting to the Federal Government. 

7 Sampling or special studies should be tised for other special data needs not cov- 
ered in the basic data system. 

BACKGROUND 

The law requires that each state sh>all evaluate, by using data collected, wherever 
possible, by statistically valid sampling techniques, each such program with m the 
state which purport^ ty> impart entry level job skills according to the" extent to 
which programs completers and leavers. ... \ 
•i. fine employment in occupations related to their- training, and 

ii. are considered by their, employers to be well-drained and prepared for employ- 
ment. ... ' ^ 

The law further states that. This system (VEDS) shall include inforWtion result-* 
ing from the evaluation required to be conducted by section 112 (aboyeTand other 
information on vocational. ... 

(A) students (including information on their' Ace and sex), (B) programs, (C) pro- 
gram Completers and leavers, (D)staff, (E) facilities, and (F) expenditures. . . . 
* Given the "law, the NatipnafCenter for Education*' Statistics' immediately held a 
series of conferences with local and state administrators. During these meetings, 
ideas and*arguments were exchanged. * fc 

Shortly after the injtial conferences had been completed, the Center developed a 
summary of the basic elements required and called a* group of state and local repre- 
sentatives together to discuss tJossible definitions and collection pr/xfefiures. When 
this task had been completed, the Center tested the system in. ten states^and made 
modifications where the test indicated they were necessary. 

The -system has been operational for three years, trie third annual report was sub- 
' mitted ten days ago* During this three-year period, the system has charigeo>periodi- 
£ally. Some of these changes have been necessary and some appear questionable. 
Many of ,the changes hav<caused problems for the states which have tried hard to 
meet the original requirements. y 

The Fiscal Year 1982 Report which will be prepared next year has been reduced 
.drastically. Some of the changes are beneficial and^some will cause harefships for 
states presently in full compliance. Fortunately, these states in full compliance are 
prdbably most able to make adjustments. 
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/ General 

ti™3?L B - an 1 i i 8eema that th f ^j 8 a ! arge n " h,ber of An examina- 

«« £ n r f ,', ^Tff' rev T'u that there are onl y three cental concerns. These 
are cost .of data, use of data, and the accuracy of data. 

J™?<Tl^J^ m0a t crit ical issue. State and local officials are concerned about 
£TW^^ g J ake i\?° m 8tuden ^"ented services for use in the. reporting proc- 
ess. Balancedsagainst this concern is recognition of the need for management infor- 

of data > therefore, becomes the second major issue. If data is not used it 
should not be.reported. Put another way, only data with a clearly spec.T^lmd le- 
gitimate use should be" reported to higher levels of government. Acceptable use it 
volves using the data in a predefined decision-making process with lorical action 

n^Z" T" 0{ t th \ d ^T 8 - F ? r exam e le ' data «>uld be colTe^ evaluate 
programs under a struc tared formula and to shift funding based on the results of 

iSrm r It U,reS operational defi nifions, usable procedures, and a reasonable report 
Cost of data ( 

Many people have studied the cost of VEDS. An examination of the information 
available mfeates that nobody really knows what VEDS coste Estimates ™ from 

firv.i 0 '^ TJfS? 6 ^ °r, rfifty dollars P" 8tud « nt - An unbiased I gstams eZ 
, ^t has estimated the cost at between eight and ten dollars per student. Th'is cost 

Ste 6 ^' ^ ^ Ulred * whlC ^ lnc i udes enrollment, completion, follow up, and 
fiscal data. An underlying assumption of this cut estimate would be that local insti- 

MrSfiSSi'SS K ata bas ? i^Hl fo , r ^cilr^SKt 

- ctent SandstaKta^ ^ lnC ' Ude data ' C0St aCC0Untin « data > 

The Federal share 'of VEDS data costs varies from state to state Some states 
would coHect the entire data base without the Federal mandate. Some states would 
notcollect anything without the Federal mandate. ,anQale - °° me states would 

VEM T^^T^J**?™ v hich can * and have ' ^creased the expected costs of 
VEDS. The first factor n changing requirements.or definitions. This, of course 
.causes changes in system design up and down the line course, , 

' J-**** J^d changk reposing formats, forms, and computer software. Local 

record to have a nuyor area of study defined by three, four, or more dSnt S 
e.g., an institution code, a HEGIS Code, a VEDS Code; a ST Code etc ttis 

„ ^ ames - «*. a Veterans* Administration Follow-up, a 

nS«Hon° * P ' V 0 ®^ Follow-up, etc. Some administrators feel tharthis to? of 

^ttrf ♦^A^i C0St8 . moi F than necessary but undermines their credibUity 

fa a tt^f "Ft m % da . te C0llecti0n covering aH occupational^aining 
is a way to both improve data and reduce costs. 

Koi.'" 1 vi aCt ° r n Cl i ^? aasoof ted with high costs is the sheer size of the data 
bases which are collected,, mainEained and reported. An average" state will collect 

twent'vTS fff! rCC0 ^ 6Very record" averse abo^ 
^M^non^hl ^^ Ch lt l m ^ avera ? e about sbt characters. This totals about 
^nfa^mrf"?** '"ft 80 " 8 database jequiring about 50,000,000 date enter 
strokes. Simply typing the annual VEDS report from computer orintouts will re^ < 

oftotals h0UrS - ^ ere ^ e ab ° Ut 30,000 ^ * * he SmSS hundUls < 

How do these figures relate to increased costs? In one state data ent™ costs iJ*. 
creased 100 percent betwen 1979 and 1980. Forms costs m&ased bfso^rten^ 
during the same period. Finally, machine and personnel cosft tacnSed by^re 

"' 

A . Cr • * 

ERIC ?7, 



34 



than ten percent. State agency costs increased from $150,000 to $190,000 that year. 
Local cost increases were not measured. i 

To a state or local administrator, these figures and facts are often Staggering. The 
budget- may have increased slightly, but the data burden costs are not restricted to 
slight increases. Frequently^ the services being examined in a report are cut back 
due to the cost of the report. 

Use of data 

fl As mentioned previously, state and local people are not aware of any Federal 
Data Use Plan. Without such a plan, local administrators are worried ajxmt four 
critical* unanswered questions. These questions are: t " ' 

1. Will the data be used? 

2. If the data is used, will it be used in a logical manner? 

3. What decisions will be made from the use? J ' 

4. What actions will result from the decisions? 

Given answers to these questions, the quality of any data system will improve sig- 
nificantly. Local and state officials can see the importance of the reporting, When 
established, Data Use Plans have had remarkable, positive impacts on data collec- 
tion systems. The experience of one state should demonstrate this point. ' 

The state legislative had required a system similar to VEDS for over ten years. 
Quality of data had improved in the initial years of operation but had reached a 
plateau. In 1978, the legislature was faced with limited resources and a demonstrat- 
ed need for change in the^Vocational program structure across the state. Many 
people felt that it was time for some realistic management actions. 

A footnote was attached to the state ap >ropriations bill which required adminis- 
trators Jto develop a system for closing prof rams which were performing poorly. The 
resources saved would be available for pr >grams which were successful or for new 
programs designed to meet new needs. * 

r A cost/effectiveness model or formula was, developed. Data reported by each pro- 
gram was evaluated and the* program was, given t a cost/effectiveness performance 
score. The lower twenty percent,of all programs (relative to the performance score) 
were visited" for a process review. Suggestions for improvement were made. When 
programs improved they were taken off a probation list. When programs failed to 
improve' they were closed. 

In the second year of operation 35 programs had been r closed, 37 were on proba- 
tion, and hundreds had improved. Almost everyone in the state who was associated 
with vocational education* was interested in the accuracy of the data. Almost nobody 
in the state questioned the need to report accurate data. I 

Controversy had shifted to the contents of the model or formula. The criteria-in- 
cluded completion rates, placement rates, the percent of minority served, the per; 
cent of handicapped served, the percent of disadvantaged served, the sex balance', 
and the cost per full-time equivalent student. 

Given the irrfpact of the data, most local administrators made sure it was accurate 
before it was submitted. Further, they paid serious attention to the factors which 
were included in the formula. Service to the disadvantaged and handicapped has im- 
proved. Sex balance in the programs has iniproved. Local administrators are more 
sensitive to program competion and placement rates, and the cost of a program has 
become a very serious issue. * * 

This evaluation process and associated data system contained what many systems 
analysts would feel arelhe ingredients for a meaningful management process. First, 
the need was evident Second, the date definitions were clear. Third, there was a 
clear decision process for use of the data. Fourtji, action was taken on the decisions. 

This particular data use plan is probably not appropriate at the federal level, but 
the example does demonstrate the value of a plan. 

Accuracy of the data 

Decisions leased on bad data are probably as detrimental to the public good as de- 
cisions based on no data. VEDS has accuracy problems. TFhey are not monumental 
or unsolvable problems, but they do affect data quality. From a strictly head-count 
perspective, or gross dollar perspective, the data is probably very accurate, ^hen a 
clearly ' defined variable is inserted, the data suffers slightly. When difficultto- 
obtain variables are inserted with good operational definitions, the data deteriorates 
more. When variables with subjective definitions are inserted, data quality suffers 
significantly. When variables based on subjective opinion which are biased by out 
side factors are inserted, credibility becomes nonexistent. VEDS has examples of all 
of these cases. - * * 

A good example of § data item that is probably well reported is enrollment by 
program type. States have been doing this type of reporting for many years, and 
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everyone in vocational education is familiar with program classifications. There, are 
of course, areas of confusion such as courses versus programs, students enrolled in 
more than one program, academic versus vocational students in the same course if 
not in the same program, etc. *. ' 

The introductiorilof level of training as a variable confuses tije picture slightly. 
Adult students, for example, frequently take a course in a postsecondary program ' 
and are not identified as adults. Further, state and Federal definitions of adult and 
postsecondary do not always correspond to VEDS definitions. Still, the data on a 
whole is accurate. & 

A variable like sex of the student is easily observable. and does not create accura- 
cy problems on a large scale. Disadvantaged and handicapped definitions, On the 
other hand, are not easily observable and do introduce error. This is true even 
though these variables are well-defined in VEDS. TnT operational definition or" a 
handicapped student at the secondary level, for example, is a student with an "Indi- 
vidualized Educational Plan' on file. These plans are mandatory for handicapped 
students at the secondary level. xwmoiuappea 

The introduction of an expanded variable such as type of handicap causes admin- 
istrators to examine each Individualized Educational Plan for data, since this ivpe 
of information is not usually kept on computer files. There coul* be several hundr^ 
of these files atany given school. ^ 

A data item like limited English abi% is extremely difficult to obtM under 
what can only ^described as a subjective definition, i.e!, "Limited EngWTrofi- 
ciency (LEP) refers to persons of a national origin minority who do not speak and 
understand the English language in an instructional setting well enbugh to benefit - 
ErSish^ 68 10 831116 eXtent 38 * student whose P rimar y language^ 

This type of jtem introduces significant error into the system. * 

The employer evaluation part < VEDS is only slightly better than worthless and 
certainly not worth the money spent. The data is influenced by the student's person- 
ality, the employer s mood, the employer's reluctance to criticize anything in writ- 
ing, and many other external factors. In Colorado, in 1979, for example, only a very 
tew former vocational students in the whole state were unsatisfactory, if the em- 
ployer data can be believed. , J ' 

Summary 

In summary, data is expensive and should be collected and reported only when 
there is an identified use. Therefore, a Data Use Plan at the Federal level would be 
helpful in two ways. First, it would identify fthat data which is necessary, and 
8ec 5?J? ; /would demonstrate the importance of the information. 'VEDS should be 
modified to serve the Data Use Plan. Special studies using a national sample could 
be conducted to answer special questions. \ 

Since information that is used for decisions shQiiljd be accurate, all VEDS defini- 
tions must be clear, precise, and easily usable. If an item is so nebulous that it can't 
be clearly defined, it shouldn't be collected. 

DupHcation of items because of slightly different definitions is very expensive. Du- 
plication of reporting is also expensive. Elimination of duplication could improve re- 
porting significantly. < 
4 . sWd be specific language in Federal legislation which funds data collec- 

?' JT ™ d . d . clanf y the importance of information and relieve pressure on local 
and state officials who now must assume the responsibility for allocating ftinds to 
thw effort at the apparent expense of student oriented services. 

Finally, states should have the responsibility for data reporting to the Federal ' 
Government. Aside from the political reasons for this recommendation, local report- < 
mg to the Federal Government would duplicate state efforts conducted in behalf of\ 
state legislatures. A second negative effect of local agencies reporting directly to the ▼ 
federal government could be the fracturing of state coordinated planning which is 
based on data. 

Thank you for >our attention during tt?e past few minutes. At this time- 1 would 
be nappy to answerany questions you might have on this topic. 

^Chairman Perkins. Let me thank you very much, all of you, for 
ymif appearance., here this mornifig. You have been very helpful, 
anU you will be very helpful to. the committee when they read vour 
testimony. , > * ♦ 

Today marks our 49th day of hearings on all the educational pro- 
grams this year. We plan oi\ holding other vocational educational 
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hearings in January and some in February, some here in Washing- 
ton, others in the field* We may hold heafingg through March -and 
Aprir. I am concerned as much as anybody about getting the Voca- 
tional Education Act- extended next year, but at the .same time I 
have been here long enough to see a lot of pitfalls ahead of us. 

I think I would be derelict in responsibility, judging frqm the 
past, if I moved a vocational ^education bill ahead of the reconcili- 
ation bill next year, especially since Mr. Stockman has asked Sec- 
r retary Bell to cut back the program from $800 million down to 
^$500 million. We are going to get to the point where this wonderful 
program would be torn*to pieces if that were to happen. ' * 

ij^nd if that happened I don't think any of you would want to see 
a bill go on the floor next year where they could tfren destroy the 
good aspects of the bill. You may think they won't. I thought we 
would ayry that reconciliation bill, the so-called Gramm-Latta, by 
12 to 15 votes. Instead we lost it last June. o - t 

I think we should get ready to move a vocational education bill 
expeditiously after the reconciliation vote next year. We've got to 
build a devil of a lot more support than we have at the present 
time, or we'll get^cut to pieces on the jloors of the. House and^ 
Senate. - j 

Before we take a vocational education bill to the House floor I 
want us to get a good group together, and help me make this deci- 
sion immediately after the reconciliation^fight. We ought to have 
this group together liere before this reconciliation fight next year, 
in Washington and have them alerted. Some of the States may not 
be able to ihake. up for Jthe Federal cutbacks that are being pro- 
pose^ Then we will lose many of our training programs in many 
States. We will see a great program, one of the greatest programs < 
> in the world disintegrate. * , - 

" So we have a .lot of problems facing us in the future and we must . 
take them all seriously. T have been* here long enough and I have 
watched it happen. I said, well, they won't tear down CETA. They 
destroyed CETA. . ' — - 0 t 

The mayors came up he|e, arfcl they were singing a good song to 
the White House. They played more beautiful music when the 
county officials came up here last year. But after they left we had 
no support in the U.S. Congress for CETA, and you* see what hap- 
pened. . . 

And then all the community services, people came to see me. I 
tried to tell them last year in January" what they had better do. 
But instead, they came in here in great masses in June and July. I 
told them they were just too late. 

We canntft get caught in our shirtta'ilfe next year, *>ecause if we 
* don't do the work on the members and* if they cut this program- 
back to $500 million in the reconciliation process, your program is 
going to be 4orn apart. 

And I am not going to let them monkey with the figures at that 
poin^on^he floor of the House. ^t that point I'd get awfully stub- 
born, after they do that much to us. I'd take a chance on the next 
election, because tlm Vocational Education Act is extended through 
1984. V 

So let's none of us'be too egotistical about next yeqf. Let's play 
the game for all it is worth. We had problems in authoring" the 
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original bill in 1963. We had a lot of disputes between the Depart- 
ment of Labor, the Department of Education; Jack Kennedy who 
was President at that time, told me to beat thejr heads together 

Enfi gLlf^Jy™ the * th « *~ 

We finally got it all reconciled between the Departments. So I 
have seen some stormy days, and a lot of people would have 
thrown in the sponge at that time, what with the disputes between 

2f hrifffiSr 48 !! B f Ut 1 dM - n0t ' ^ 1 want to ^esuTe Sal we 
f,™ f «f » «" of our gains and not dissipate them. You ca#get 
'fooled on the floor mighty easily. uur-gei 

kJ^i 40011 °Y er - e chai npanship of this committee in 1967, I 
" tw . th ? count against me on the Economic Opportunities Act. 
, They said it was impossible, but I worked thatVhole fall, State bv 
State, got enough commitments out of the South, the -Midwest and 
the West, until I knew the bill woujd float. And then iSJtt 
and we made progress with it. . ."" vcu 

I rarried a little book around with all the members from the var- 

i^PSS 8 and marked th ? m off , every ni « ht ' for 90 ^y 8 . so I have 
had a little experience at these things. 

lJSSt g6t ?if d * y I 0r this conciliation fight. I am telling your 
leaders now that this reconciliation fight next yeaftehould be our 
first priority. If we lose that, Carl Perkins won't brhig any bill out 
next year. He will wait until the 1982 elections are over with I'd 
hke,to move this bill next year as much as anybody, as much as 

^l^' 1 ^ 6 ! 8 ',^ that de P ends on our in fighting 

thurreconcihatipn battle next year. B 

If welose that we will take .no chance, my friends. We will take * 
no ci mn ce« > ... y * 

m^5^ w mp Si nent , a11 , ° f you here for excellent testimony this 
morning We will work closely together the remainder of the year 

f^fiT^i! 086 ?? 1 " n ^ year i T^oughout we will have a consid- 
erable number of hearings, and we will try to let your leaders help 
us get in representatives from all sections of the counW When we 
do go to the floor, we must be pretty much united.' We can't have 
J% ^ ni °i" fSjSS? 8 fi e h ting the secondary vocational people. We've 
got to get together on this thing. We got together a'few years ago 
and we can do it again in the future., • • j 

fi,? Ut ^ let ' S i° nc ^nn rate „? n this reconciliation" process, because if • 
they demand a $800 million cut out of this program y?„ can imag- 

tSrtl?«! g °^ g - to d °- t ° 1 . the Let's get prepared tor 

^^^S^ hereaad let them 8tate J hat effects 

can'?wfw to <Sn Stffififf " ^ & ^ W * 

And I think some of our" friends that voted wrong this year will 

sEe R tlc a 1 year about destroying a good pro- 

S J** 8 , 1 *^ afi of America, especially when we 'are^not 

* a3 f 0Se *? y ^ u i g ? te -. If we destroy this program, it is 
^omg'to create greater deficits in years 'ahead. ' 

an^tS^abou? 6 tWngS thSt W * W ° uld like you to g0 

Now it appears to me this administration may be in favor of 
elimination of the Vocational Education Data System. I'd like to 
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ask Dr. Senese whether the administration is endorsing continu- 
ation of VEDS in a much ^educed form and why? 

Dr. Senese. Mr Chairman, presently the administration is re- 
viewing the VEDS system and no decision has been made yet on it. 

Chairman Perkins. What's that? ^ 

Dr. SeneseI Presently the administration^ reviewing the VEDS 
program, and no decision or recommendation has been decided 
upon. t 

Chairman Perkins. You don't yet have any recommendations 
along this line? 

' Dr. Senese. No; I do not. * 

Chairman Perkins. I don't want to ask you to talk about budgets 
or anything like that because you are not in a position to talk 
about the budgets, are you? 

Dr. Senese. No; I am not. 

Chairman Perkins. Well let me compliment all of you, all of you 
distinguished gentlemen thik morning. You have been most helpful 
to the committee. I wish all of our members were here. But you 
will not have greater cooperation from anyone than you well from 
Carl Perkins. I thought we all should be alerted about the future, 
about those who want to cut back thik program beyond the point of 
no return. 

Let me thank all of you. 

[Whereupon, at 10:47 a.m., the subcommittee was adjourned.] 
[Material submitted for the record follows:]* 
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CONGRESS OF THE UNITED STATES 
HOUSE OF REPRESENTATIVES 

COMMITTEE ON EDUCATION AND LABOR 
SUBCOMMITTEE ON ELEMENTARY. SECONDARY 
AND VOCATIONAL EDUCATION 

•4«C RAYUMN HOUSC OfTIC* BUILOINQ 
WASHINGTON. DX. Wit 

December 28, 1981 • 




Honorable Te/rel H. Bell 
Secretary 1 
,V.S. Department of Education 
Washington, D.C. 



Dear Mr. Secretary; ' ^ 

Data s^tel oT^^Jo 6 ^^ 9 "i the Voc *^ Education 
to *«k «n \u f. ' the Su *>comroittee members were unable 

for the hearing record? 9 " additl ° nal questions, to be answered 

Our questions are as follows* 

Sincerely, 



Carl D. Perkins 
Chairman 
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THE SECRETARY ^ 
WASHINGTON, DC 20202 



The Honorable Carl 0. Perkins 
Chairman 

Committee on Education and Labor 
House of Representatives 
Washington, D.C. 20515 

Dear Mr. Chairman; ♦ 

I appreciate the opportunity to prqvide you -nd your subcommittee with * 
additional information regarding the Nat'.viial Vocational Education Data 
System (VEOS). , 

Jfour f1rst;quest1on concerned the ^ministration's position with respect 
to the reauthorization of VEDS. ^s Dr. Senese Indicated In his testimony / 
on December 10, 1981, we are currently taking a comprehensive look at 
VEDS, and at this time no fi i u l decision has been made concerning the 
reauthorization <tf VEDS. * • 

Your second question c< .oerned the scope and Impact of the changes in VEDS 
which the Department t .^s Instituted for the current (1981-82) data collection 
year. These changes consist entirely^ suspensions of certain portions of 
the previous (198 c -,l) data col lectffjpsy stem. As NCES began to study tKe 
returns fcom the "irst two years ofJRieratlng VEDS, it became evident that 
certain portions of the system were* not only perceived by the States as 
excessively bur^nsome, they were also providing data of low reliability 
and utility, therefore, working with the cognizant portions of the Depart- 
ment, NCES 1 er>if1ed these portions. of VEDS as ones that could, consistent 
with the ml *d:te of the law, be suspended until further study and redes1o/r* 
of the $ysU.i takes place. Such study and redesign 1s now going on, tuywe 
expect th:t these suspensions will remain In place at least for^^taTTiext 
(1982-83} data collection year, . 

I can sum up the suspended portions. of the* data collection as folloj) 

1. Teacher/staff data:- these»<Jata are stable due to the lack ©A 
staff changes from year to year. 

2. \ Employer follow-up data: these data' also change very little 
\ from year to year. ( 

3. Program leaver and follow-up data: these data exhibit a low 
return rate and are expensive. 





41 



'found* &t"!5itt/3 , 22 t °L2 B8 are those wh1ch th « tes have 
«jor burden « cost *™ 0 n^ ari^,'^* Sus ? e ns1ons " 
« to reliability, utility and L™L\ f T the ^'""er of VCEOS improved 

Sincerely, 
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NORMAN Y. Ml NTT A 
4 MM*W«-« 
lltxCwflO C 



TMMRWTATION 

■uoocr v 

fOMAMMT MUCT COMMUTES 



Conjjresfc of tfje fflnitefa fttate* 

ftouft of fcttftttnUtitaf 
WiilliiiUliiii, 3WC 20515 

ffrll 15, 1981 



The Honorable Carl Perklnst Chairman 
House Education and Labor Committee 
2181 Rayburn House Office Building 
Washington, D.C. 20515 

Dear Hr. Chairman: 

Enclosed are two brief statements concerning the reauthorization of 
^the Vocational Education Act which I respectfully request be Included In 
ttthe official hearing record on this matter. 

Both statements were submitted to me b/ conrounity college administrators 
1n my district and concern, specifically, the Vocational Education Data System^v 

Your Assistance fn this matter will be greatly appreciated. 




NYM/sjd/w 
Enclosure 



NORMAN Y. HINETA 
Member of Congress 



Hi* tTATlOHMY PMIMTIO ON PAFKN MADE WITH 
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TITLE: VOCATIONAL EDUCATION DATA SYSTEM: ITS IMPACT ON tAe " 

LOCAL COMMUNITY COLLEGES AND THEIR VOCATIONAL PROG1AHS 

PREPARED BY: FOOTHILL-DE ANZA COMMUNITY COLLEGE DISTRICT 

OFFICE OF EDUCATIONAL SERVICES, VOCATIONAL EDUCATION^, 
ROBERT W. WALKER, ASSISTANT DIRECTOR / m ' 

PURPOSE: USE BY THE OFFICE OF NORMAN Y. MINETA, MEMBER OF CONGRESS, 

AS TESTIMONY FOR THE HEARING RECORD BEFORE HOUSE EDUCATION 
AND LABOR SUBCOMMITTEE ON ELEMENTARY, SECONDARY AND VOCA- 
TIONAL EDUCATION DURING DELIBERATIONS RELATING TO THE 
REAUTHORIZATION OF THE VOCATIONAL EDUCATION ACT. 

DATE PREPARED; MARCH 16, 1981 

t 

iTJttll * ° Ur ? 1S T Ct Und " the P rovlsl °ns of the Vocational Education Act has in- , 
creased very modestly over the eight year period from 1972 to 1980 „L*1 aI^J 

increase has been $44,000 (from 270,000 to 314 00C» tm! ^ actual dollaf 

areas o a * e * * * • (To haye ffiaintalned Qur ltlon reUtive t * . 

* rtf U 121 "dramatic",^ ™ " bE $A81 ' 00 °-> ™« a -",000 

«I M^.S1 <T t effe " "T r r aM1Ity t0 SU PP°" our vocationa* pro- 

^« "T " WhICh e<1Ulpment and P r0 «sses bee** obsoWrttnin exceedingly 

short period,. A significant local industry demand is placed upon our camples to 

Held; "LchV^ retr " In P .K rS ° nnel In ele "™nics, data processing, and^ne health 
« L«1k ""J In the la8t eIght y™" ^onstrated technologic- 

ISll rtS£ Is cLe V ro\£ °^ a " 1Ity " DaIntaIn P r °8 raOS at an equipment 

S on teV IV thE co P loyment environment our students face upon program com- 

our aoiiitv^,, V 'J 8 '' ta X e alS ° ^ 8 «<*»=ndously Italtlig effect up 0 r 

progra» Le neces,^ V ? an "equipment or personnel intensive" vocational 

profr"; i?to yocat^J 01 / 0 " Increased "" al dollar" assistance to these 

programs is to vocational educators real and dramatic. . 

?^ S ^" lfIC8nt adnI - nIs " at l ve concern over these same years has been an ever incfeas- 

l t S,L"« to l r » ,Uite H U t r Pr ° Vl8l0nS ° f < he VEa act4dotb:r vocational 
o f l » ""porting" requirements in 1972 were essentially directed 

.1 ? V and demonstration of maintenance and expansion of P ff"t . 

The required report preparation was consistent and compatible with our existing ™ ,.,^., 

significantly to the* effort required for compliance. Major adaptations and redesign of 
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registration procedur*s,*4lassrooo reporting mechanics and data processing designs 
have been required. Increased data collection, processing, and storage has been 
necessary. The direct cost of VEA reporting for purposes of accountability probably 
now exceeds $45,000 or M of the allocated funds. 

a *■ , 
Coapl lance with the new reporting requirements of the Vocational Education Data 
System mandated by PL 94-482 and developed by N.C.E.S. will produce a dramatic in- 
crease in the local, state and national cost of vocational education reporting. 
The specificity of the data requested and the imposition of student and employee , 
follow-up procedures will locally refuire major changes in registration and program 
operation,^ as well as, the development of entirely new follow-up procedures. The 
net result could be an increase in reporting costs locally which may reach $30,000 
and bring our administrative burden for all VEDS and VEA related reporting activities 
to $75,000 or 2UI of our allocated funds. It has been estimated thaP VEDS will impose 
$5,000,000 of additional costs upon the responsible schools and agencies in California. 

/ 

Vocational Educators have repeatedly expressed the following reservations and concerns 
in respect to the Vocational Education Data System (V.E.D.S.): 

1. VEDS will not answer the basic questions asked by Congress in regard to'Vocational 
Education. 

2. The specificity required by VEDS is greater than can be utilized on an aggregated 
national level. < 

3. The validity of the results are questionable when aggregated at the national level 
as required by VEDS. » 

s 

'U. The aggregated results will be clearly subject to misinterpretation. 
5. The cost imposed is excessive at the local and state levels. 4 

Although the VEDS student enrollment report may eventually be perfected to provide NCES 
with reasonably accurate information on student enrollments, its usefulness will have 
serious limitations, due to data collecting problems at the local level. The usefulness 
of the VEDS student enrollment data diminishes, the farthef it is removed from the local 
district sites. The quality of stvate and federal level data is dependent on the qtiality 
of the initial data collected at the local levfel. 

The Employer and Student Follow-up VEDS reports will not, in our opinion, accurately, 
or effectively, report representative data on community colleges. This portion of the 
VEDS system presents biased, skewed, and potentially misleading data and^is not a 
reliable basis for planning. Periodic regional studies of program effectiveness and 
formpl assessment of this effectiveness by polling of local advisory committees, 
industrial and commercial agencies, artd other community agencies would produce move m 
reliable and valuable assessments* The National Policy committee for VEDS has unani- . 
mously recomrnertfed that NCES abandon the proposed employer follow-up system—substituting 
if necessary, feedback information from employers by way of program advisory committees. 
NCES to date his made no ch^hge. v 
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a) funding i eve is had been malnc/lned near the real dollar values of 1972, ^ 

b) reporting requirements f'or.vocatlortal education from all federal and state 
•agencies were requested In stmUar formats and utilised 

C> iere r not r i n posed eqUlrenentS Und " "»«tlon Data System (VEDS) 

sions of V.E.D.S. and returning to the reporting procedures previously in place. 
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EVERGREEN VALLEY COLLEGE 

> 

CONCERNS REGARDING THE * / 
VOCATIONAL EDUCATION DATA SYSTEM REPORTING REQUIREMENTS 



Our community college serves hundreds o1\ vocational students annually. 
The VEDS reports are extremely complex* There is literally no way iji 
which VEDS reports, as presently constituted, can be completed without 
extensive data processing assistance. The data processing programs 
which we^eed do not exist. Th>y will have to be "conceptual ized, writ- 
ten-ano* pilot tested before they ca/i be used. The process will take' 
several months. In the meantipl, we are required to provide data which we 
cannot yet obtain. We are being asked to identify*, follow-up ana report . 
on 16 different categories of Students— a monumental task. We are being 
asked to provide wage and salary information, by instructional program, 
within a standard occupational classification, subjectively . This -process 
is both redundant and meaningless. \ , ** 

An employer follow-up of former students is also required. From experience 
With similar prior projects, both former students and current employers 
strongly resist giving out this type of information. Both groups are con- 
cerned with and support the right of the employee to confidentiality. 



These brief comments are intended to convey that th* VEDS data requirements 




We urge that the VEDS requirements be drastically modifie'd, to meet the con- 
cerns outlined above. 



GS0/qa"a 
3/3/81 # 
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Hie Honorable Carl Perkins ' 
Chairman » . 

Committee on Education and Lrfbor 
,U.S; House of Representatives 
Washington, D.C. '20515. ' * 

Dear Mr. Chairman: - • * 

Enclosed is a positioner the Council of Chief State school .Officers' 
Committee on Evaluation and Information Systems concerning the 
mandated Vocational Education Data System. We would appreciate the 
inclusion of this-sta^ement in the formal hearing record on the y ' 
reauthorization of the Vocational Education Act. ** * N , 

*' As you are aware, the Chief State School /Officers *aVe complied with 
the legislative provisions of this mandat/ even though we had serious 
concerns over the size &nd accuracy of/the proposed system 'from its 
early design. We haue consistently requested changes and improvements 
in the system but feel that legislative retirements preclude the 
possiblity of immediate relief unless«recommendations included in our 
statement are seriously considered.' Concern over this issue should not 
be construed, however, as a lack of willingness to be accountable for 
federal monies. We do support an acceptable Vocational Education Data 
system and stand ready to assist in the redesign of a system that wiH 
yield valid, usable data. The Council appreciates your consideration of 
those concerns and wish to convex a continuing admiration and support 
for your tireless an|ef fective leadership in the cause of public education. 

Sincerely, 



Executive Director 
' . WFP/gjs 



i CCXUSCn. Ot CHIEF STATE SOHOOL OFFICERS 

37ft H4\ »t Ihf Slrftrs, 400 Nurlh Opilol Slreet. N W , Washin R toft. D C 20001 • 20^4-7702 
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' « o STATEMENT OF THE 

COMMITTEE ON EVALUATION AND INFORMATION SYSTEMS 
* * OF THE 

** COUNCIL OF CHIEF STATE SCHOOL OFFICERS 

(CCSSO) 

<4 « t 

Public Law 94-482 specified that a Vocational Education Data System (VEDS) 
be developed for the basic purpose of compiling descriptive statistical data on 
vocational education programs being operated .throughout the nation. The 
rationale of developing a common reporting structure serving multiple 0: 
agencies represented a concept that the Council of Chief State School 
Officers (CCSSO) indorsed and supported. As U.S.O.E. and N.C.E.S. began to 
define the parameters of the system based on legislative language and history, 
if became apparerjt that significant problems with Burden, cost of 

iptementation and state capacity to report were arising that would be 
difficult to address. During the past several years, extended deliberations and 
dialogue wittt N.C.E.S. have been maintained but sufficient resolution of the 
technical and administrative shortcomings of the proposed VEDS never 
reached the poin^that the states could recommend the system. Recognizing 
the expressed needs of Congress and the legal implications of the legislation, 
state and local agencies have expended' vast f^cal and human resources for the 
purpose of complying with VEDS reporting requirements, and in many 
instances, have been unsuccessful in doing so. The severe fiscal constraints 
and increasing data*burdens facing states at the present time^ should, 
hopefully, prompt some redirection in the reporting and accountability 

mandates placed on the states in the current legislation. . 

, — •» * « 

Two years ago the Council of Chief State School Officers' Committee on 
Evaluation aiid Information Systems (CEIS) developed a position paper which 
laid out, in detail the many concerns states had with respect to the VEDS 
reporting requirement. Some of those concerns have been able to be 
accomodated by "NCES, and some hate not* In some instances, modifications 
made in VEDS still do not correct the fauUy premises upon which VEDS is 
based. Several of the major concerns with the VEDS legislative mandates are 
expressed below along with specific detail to relate policy to practice. Where 
possible, there are specific coijgses of action recommended to address stated 
concerns and we respectfully 'request that they be/ considered in a review of 
the legislation and resulting system. 



I, Public Law 94-482 was drafted in such a manner as to provide funds for 
specific purposes' that, in mTany cases, established nefVv directions for 
vocational education programs. The developers of VEDS attempted to 
take old methodologies and procedures for compiling vocational 
education data (i.e, reporting student'enrollment at a 6 digit level of 
* detail) and make modifications to assess new program directions. As 
such, VEDS^ust "addAd on" additional requirements to an already 
cumbersome reporting process; 
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than one program* When pr^a/hs are described in verV finite tern^ 
the desdnptions approach those of courses that pnmnrf« « terms, 

enroument data in a duplicated manner if more^ZZLleUn 

Serious questions have been raised about the viability of <sh.H«nt ' 
programs. mere is considerable concern over the use of this 

emphasis that is placed on its co^tioVat the /Seraf leve" 

Time has shown that most follow up studies have significant ' 
^respondent biases and the data have limit^ utUUy tVD<JS of . 

data arrays should be deemphasized at the federal level Inri^nif™ 

SSm some of the - '"^ vocational informa »"" 

to our knowledge, in developing a^SteiS" U?il WateTy relays ' 
o^ P ^f,° f inf0 J mation "0 P«>v1de accurate measures "he 
Sffi ^'»n?™ "I" VOCati0nal edU ° aU0n *™*» P™I* 

EST.?' f*" 8 !" o VEDS M *"«ment8 mandate4nalyses of foUow uo ' 
data according to Standardized Occupational Classifications fteorw 

2335? a unit weort (individual «--«ty*!?£S?$S,i 
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Tjie attendant inaccuracies of follow up data and matching jobs to • 
instructional programs make the whole data base questionable" for use 
at any level of government* The desired supply-demand analysis should 
'not be driven by such inaccurate unidfcnensional measures. We • 
respectfully suggest that these analyses and reporting requirements be 
removed from legislated mandates. ■ . - 1 

Most categorical programs operated (W federal agenciesjare guided bj a 
hierarchical principle with respect to information collection and use.' 
Local education agencies need more detailed basts of information than 
state education agencies; state education agencies need more detailed 
bases of information than federal agencies. The level of detail required 
in the P.L.94-482 legislation (as embodied in VEDS) fa^^^sses that 
required by most state agencies and in some instances, local agencies. 
This situation is^he inverse of generally accepted-data collection 
principles and the degree of utility these large data sets have at the 
federal level is questionable in comparison to cost and imposition of 
'acquiring them. j 

In addition, the legislated VEI?S reporting requirements mandate that 
vocat^jnal educators collect and report data that are in some cases 
inappropriate or unobtainable within the content of the vocational 
education program. In many states vocational^<Jucators do not have 
access to information on students handicapping conditions, language 
proficiencies -or economic or educational disadvantages. Also many 
states do not maintain separate fiscal accounting structures for ' 
vocational education. 

The National Center for Education Statistics (NCES), the Office of 
Vocational and Adult Education (OVAE) and the Office for Civil Rights 
(OCR) fcave attempted to "sVstematize" Congress' initiative to monitor 
access to programs by partially using VEDS as a vehicle for the data 
collection efforts. While the consolidation of reporting activities is 
usually a laudable concept, the reporting of race/ethnic data and 
special needs data (i.e. disadvantaged, handicapped, limited English ' 
proficiency) have become annual reporting requirements in VEDS at the 
most specific level of detail. ] 

In the instance of race/ethnic data, this mandate should.be left with 
OCR and collected on a periodic basis, as deemed necessary to meet 
Congressional intent. It is anticipated that the level'of detail for this 
^ data collectionVould be greatly reduced and still provide usable "first 
cut" information for OCR purposes. 
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H ? special needs data should be assigned to other units within 

SEJmE? •Sf ♦ u #! 3« 0 " responsibility for the service being 

SSSSfwiT'V ^ 06 ° f Speoial Nation should have the 
resKsnsibJlity for determining the number of handicapped students beine 

uJtiy^Zf ^ a?enCy re *°^iWe for monitor!* Chapter 

I (of the Consolidation Act) should have responsibility for determining the^ 
number of disadvantaged students served, and data on limited EngUsh 
- proficiency students collected in a like manner. The key issue is that 

vocational education services to these students are secondare to the services 

',2Ki'-£ 60181 edU0ati0 3 n nee * tyPi^ly information ab^u ' 
the special needs>|sides with those responsible for meetirg those needs! 

The intent of the enactment of the Vocational Education Data Svstem was to 

SESi&VS* re <> uireme " tSand ^uce reports burden Ty devei^, * 
a "single data base" which could *e accessed by many users. That data base 
however, encompasses certain types of information not germane orTbtSle 

f« 1 ? UOat °r ^ S * reSU "' state ^education agenda* 
£Z«t „„ £5? f an(1 - m . a ! nta i n , Some 'VP 63 0' oat* a vocational education 
context as well as a special needs program context. Nowhere is this problem 
exacerbated more than in the area of fiscal accountability. Itate and local 
agencies, as a rule, do not maintain separate fiscal accountability systems for 
vocational education. However, the federal fiscal reporting requirST for 
yocatjonal education requires the establishment of data sets that are fn excess 
' f.(t t , h ° Se ^ eeded t0 be , maintained for other federal fiscal reports. There is 
• little evidence at the federal level that fiyal accountabilitlfor vocational 
( <Ulucatio»,hould be expanded from that required by other f ederalTroSs. 

/^S'n'Ttl^fK 0 ^ 00 ^' 0 " 81 "Nation reporting mandates should be 
°J^™ . . Wlth 0ther federal ^Porting mandates to insure that, where 
/ possible, data are generated by the most appropriate sources. 
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l >-V. Severe definitional and infomation management problems have resulted 
^ from the continuances of data collection strategies that prevailed prior 

to the enactment of P.L. 94-482 plus additions needed to address the 
new directions set forth in that law. Some states are operating three 
separate data collection systems to comply with all VEDS reporting ^ 
requirements (Secondary, Adult, Postsecondary) due to the fact that the 
delineation of t'he types of agencies offering vocational programs has 
become too prescript ive; In addition, VEDS has attempted to address 
the general statistical requirements of the program units within the 
Department of Education and the compliance information requirements 
of units within and outside the Department. This "Single, Central Data 
Base"^pproacjrto data collection is not, in this case, easily facilitated 
by state and local education agencies. Program assessments and 
compliance issues*are, at times, at cross purposes and common data 
sets are not realistic. P.L. 94-482 currently requires the compilation of 
huge data sets for annual state plan and accountability report updates 

in addition.to the massive volume of data require d in^VEDS. If the 

state plans and accountability reports are to be retained ln~future 
legislation, states should be excused from comparable data reporting 
requirement s*!n other sections of the legislation. Where data sets can, 
be used for a variety of purposes, the data should be collected one time 
and disseminated internally as appropriate. New legislation should 
endorse these concepts in spirit and practice. 

VI. Congress should give due consideration to using fewer, more accurate 
benchmark statistics for the oversight of vocational programs. The 
legislation should coordinate reporting requirements with the j 
programmatic issues addressed by the act, even if it is at the expense 
of curtailing traditional data collection activities. 

In summary, many states will expend more dollars per participant for the^ « 
collection and dissemination of information in vocational education programs 
than for any other federally subsidized educational program. This expenditure 
is not consonant with the very small percentage of the total cost of vocational 
' programs supported by federal monies. States are willing and expect to be 
held accountable for the use of federal revenues, as they are held accountable 
for state revenues, but the accountability must be held in proportion to the 
magnitude of federal support. 
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Community 
Colleges 



District Ad/Tuntttrauon 1 370 Adams Av«no« v Co$t* Mesa, CaWomia 92626 
< » January 7, 1982 



Honorable Carl D. Perkins, Chairman 
Subcommittee on Elementary, Secondary, and 
Vocational Education* 

B-346C Rayburn House Office Building V. 
Washington, D. C. 20515 • ^ 



te a r Congressman Pe r kin s : 



<in e Can^?/f^^? n !! Communlt y and J^ior Colleges and ml colleagues 
X&fJl III £1 5 ppr ^ iat ? tne opportunity to further clarify our position 
Ke?Vo^K " the testimony on 

•♦The vocational Education Data System does not provide meaningful 
or useful.data at the local, state, or national levels." j u 

This statement has been generated based on experiences which were reiorted 

' ^Hn O Pre f!! tati0 f S ° f James Harris and *nald J. Senese ft thT 
J !I d tave alSp ? een «P e ^ enced ^ California. Just Vfcinforce 
some of o the concerns, 1t should be noted: 

• Egeral data has been aggregated, when you get reports on place- 
?J?Ji ^« *S2I eirS • a 5 d con, P ,eters for an auto program you are getting, 
^lSJii^n? 600 ?^? and the P° stsec o nd ^y P^gram. -it is>itheV 
^nnlh yfu 0P Valld to compare programs which may be two years in 
WfM^ ^ ™ 18 ***** in le " 9th 0r * compare £> p le 

* ^"^V^r* ?" the Survey G^.m m the secondary programs, 
spumes tend to stay close tp W for the first year after gradi- , 
SESkhiS?? 9 f0r 3 P°tential df 30-40 percent return. That fs / 
acceptabl*but not outstanding, m the pbstsecondary system, the 

K ran V V6ry 7° bn ? ak ! nq the survey return average a bou 12*. ' 
4 No one can draw real conclusions from that size return. " 

' - * ^ting the Data Back. I have been in education for twenty one 

years. During that period of time I have yet to see any data reDorted 
by one of the districts I have worked for returned to the districts 
^rSTSfTl US ?'*J h | S d ?<? di ? a PP ear s Into the woodwork. When 
E El flnth ■* ^ local level, that Information 1s given back 
IS. wS 1* 5 m its report^ form so the management team can 
^ evaluate 1t and make changes. 1 

ORAWOE^C OAST COLLEGE GOLDEN WEST COLLEGE COASTLINE COMMUNOY COLLEGE KOCE-TV (50) PBS 
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• Repetition of the Data Requests . The Federal Government has one set 
of requirements for reporting on programs for vocational education and 
another set for the Office of C1vil\R1ghts, etc. It Is difficult, 
time consuming, and non-productive to collect the data, particularly 
when the requests all come In at different times. 

• Employer Information Is Useless . Taking Into account the current 
requirement has been suspended, #iat requirement was a voluntary one 
on the part of the student. At, least in our' district* Jess than 5% 
of the students chose to volunteer employer Information and less than' 
12% of the employers from that 5% reported any data. I contend that 
this was typical of the data 1n California, and from a research stand- 
point in making Inferences, assumptions or* conclusions, it is useless. 

You have asked if the American Association of Community and Junior Colleges 
would recommend repeal of the VEDS requirements, or if a simpler way exists 
for gathering more useful data. 

Both the National Association and the California Community Colleges would rec- 
ommend that the following principles guide any fmp/ementation of Federal data 
gathering efforts which are mandated by legislation: 

• A direct quote from the adopted*^eg1slative position of the Califor- 
nia Community and Junior College Association on Federal Vocational 
Education states: ' v 

"9. Develops and Implements Reasonable and Meaningful Accountability 
Requirements : While accountability is an important and reasonable 
requirement of Federal funding, the process should contribute only 
necessary and useful data which will assist local, state, and federal 
agencies with information for the improvement of vocational programs." 
Such processes must be at a reasonable cost to local agencies or 
{ supported through the funding source." 

, Taking this policy recommendation Into account, the California Colleges 

and I presume AACJC would endorse* the ^recommendations which were 
.placed Into testimony by the American Vocational Association which 
- include: * « 

• A data use plan should be developed at the Federal level. .This 
plan should Identify the goals and/or objectives where achievement 
will be measured, how achievement will be measured, and the data 
necessary for, measurement. (We would amend this to assure state 
and local acceptance of that plan and limit the plan only to the 
necessary data, I.e., are students placed in an area whey they .are 
trained and are employers satisfied with the training.) 

• Only data that are needed for national decision-making will be col- 
lected i"n the basic data system at the federal level. 

• Every data Item In the system should be operationally defined. 
For example, a disadvantaged student 1s operationally defined as 
a student who qualifies^for financial aid under an economic need 
program. (We would recommend that tnese operational definitions 
be limited in scope to areas which can realistically be collected.) 

t Federal reporting systems concerning occupational training activ- 
ities should be consolidated andolimlted to essential and necess- 
ary dat£. At a minimum, federal requirements for data should be 
v_ definitionally consistent across the various federal reporting 

;systems. 
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* There should be funding specified for data systems. ' 

* ^r,n^' d h3V ! f he res P° n sibility for collecting data, from 

* 2Sllnt? K institutions * nd reporting to the Federal 

t Sampling or special studies ^should be used for other special data 

55 C0Vered in the basic dat * system. (California would 

£ !^L^°W n<tation t0 in ^ lude * hat sam P lin 9 be sed for the 
basic system requirements where it is more feasible and will 
maintain validity and reliability of tE data?) 

In addition^the association recordations would include:. 

* S?!? y Hrf SatlS - f ! Ct1on re <l uir ements should not be a part of the 
-basic data requirements and should be a defensible system HpCpI 

tne state and the federal government. 

" M^55h*? r6[; ? r i! d 10 the State or f ederal Government f„ 

Si^t^aVSiSK ^X" d back » f ,ocal • 

such a plan would remam^with the state* 

of «S2nUb,f?S C baSlCa . ,,y 1 " aCCOrtl and workln 9 tosethS on ?he iss£ 

Sincerely yours., 

' ; . 

Donald F. Averill, yice Chancellor 
Educational Planning and Vocational Educatidfr 
kh „ f 



cc: See Distribution List 



Distribution List: 

Lois Callahan - Chairman of the Commission on Vocation / 

B 0ea„ Sn,; -Tml I?"™' CiUT ° r ° U Mt > C °"T 
Dick Wilson - AACJG* ' I \ 

Gene Bottoms - AVA * / 

Dean jGrif fin - AVA 
Bob Price - Saddleback College 

Dr^ Norm Watson - Chancellor, CCCD * 



/ 




9 

ERLC 



59 . 



56 



STATE OF COLORADO 



State Occupational formation 
Cfaoriiiutinf Committee V5QKQ 

(me* L Hun. Director 
1313 Shemun Uttfi. Room 218 
Dmvet Colorado 60203 
003) 666-3335 ft 

January 22, 196tV " 




The Honorable £arl Perkins 
U y S. House of Representatives 
2328 Rayburn Building 
Washington, D. C. 20515 

Dea^r Mr. Perkins 4 : 

j Thank you for your letter dated December 28, 1981. I would be 
most pleased to answer your question which was: 

"(Does) the American Vocational Association feel that Congress 
should repeal the requirement for*VEDS, or whether Congress 
should find a way to cut down on the data collection and make 
it more meaningful?" 

The American Vocational Association recommends the latter al- 
ternative. Congress should require states to submit a limited data 
base for program planning, monitoring,- and evaluation. 

This data base should cover programs which are under the jur- 
isdiction of the State Plan for Vocational Education. It should 
contain information on* the enrollments in all programs. ^The programs 
should be classified into two types: those which are designed to im- 
part entry- level skills and those which are not designed to impart' 
entry level skills. Data about both types of programs should be re- 
ported at a two-digit level. Furthermore, enrollments should be 
categorized by program, and sex. The categories of handicapped and 
disadvantaged should be eliminated. 

Data about numbers of completers should be obtained from all 
programs and should be categorized by program, and sex. The employer 
follow-up should be eliminated. Follow-up data on completers should 
be obtained from states on a sample basis once every three years. To 
supplement this-sample-Jata,.a national longitudinal study of secon- 
dary and postsecondary completers should be conducted. This study 
would focus upon: *&H&* ' <» 



The completers&enhanced satisfaction with their occupational 
choice ; 

The completers 1 increased occupational knowledge and skills; 
The placement of completers 1 in employment; and 
The potential utility of the completers 1 skills in the work- 
place. * 



Cok**Jo fmployrrxnt *nd 
Tf*rwn CounoJ 

Ovryon of Commerce 
*ftd Oevttepmeni 

Ovrs*oo o» £mploym*n< 

Ovwi ot QoCupjbOfvtJ 
Educ#<on 

Ovrvon o» VXJtOru*) 



1- 

3. 
4." 
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, , P* *S lic ! tion in accou nting procedures wifich currently exists 
between VEDS and GAPA. (section 406-A) should be eliminated. Insti- 
tution specific accounting data should be acquired through a special 

We feel that this scaled-down version of VEDS will stTene^hen^ 
art improve the reporting system. It will help to make ?he dl ta 
more accurate, meaningful, and useful for decision making purposes. 

fr^f* ^ U 1°/ a ? lowin 8 t0 te stify and thank you for the 
friendly, yet effective way you conducted «rhe hearings. I, person- ' 
ally value the experience and look Stfrwardto a good vocational bill' 
developed by the subcommittee under your leadership vocatlonaA DU * 



Sincerely^ 




'James L. Harris 
Director 



JH/eb 
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m~ <ft*. , * 362 2132 
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August 26, 1981 
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The Honorable Gerry E. Studds 
. 1501 Longworth House Office Building 
Washington, D.C. 20515 

Ijcar Representative Studds: 

The existing .Vocational Education Data System (VEDS)l reporting requirements are 
extremely costly, time consuming and comjHicated. Compliance with these requests-— 
is especially cumbersome at the community college level Vhere students often do not 
declare majors until at or near the time of graduation, ind non-attendance for one ( 
or more semesters does not necessarily imply that enrolment has ceased. 

As the Federal Vocational Education Act (Public u/ >4-4fc) is currently undergoing 
reauthorization hearings and VEDS requirements we*e promulgated^ a result of the 
present legislation, reauthorization should simultaneously addreflT lessening these data 
requests. t 

No additional funds were made available to develop data systems to support VEDS 
requirements. Although efforts have been made to increase the interfacing of VEDS, 
HEG1S, VA, and OCR reports, one survey should be developed and implemented at 
the federal level to collect all required information simultaneously. 

In the Interest of both more accurate reporting and more efficient %ata collection, the 
"following areas of the present system need changing: 

Although the state to federal expenditure ratio is in the order of 10 to 1 
(not 1 to 1) we are asked to report on all programs. Detailed reporting 
requirements already exist for tracking enrollees in federally funded pro- 
grams and should suffice. 

Individual courses may serve as requirements or electives for a number 
of different programs. As most students do not declare a major until 
well into their academic careers, course^data would be much more reliable 
» than educated guesscS at their appropriate six-digit program classification 
* now required. \ • © 

Some students do not, or are roost unwilling to, identify themselves by 
ethnic linquistic. . handicapped, academic or economic disadvantaged labels, 
resultingln target populations actually served greatly exceeds reported 
figures. * * * 
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Reporting requirements for students In non-degree granting proerams 
deg f r r s,udents 0 - Credlt h ° Ur8 ™ ^ " ™ - 

The student tracking problem is greatly increased bv transter-ln .nrf 
transfer-ou. students. A simple "method is nSfed for S,g hte . 

rate sufficient to draw sta?isticslly vslKcl u dons ,Wd ' rCSp0n;ie 
We support full accountability for federal program monies, but the VEDS -„„i„. 
d^TneT^^ * we have a 

^ r D un]^iege.!l^ e J!; 0US C ° nCernS wffl be e~"l y appreciated at Ca'pe Cod 



Cordially, s 



Presi d ent 



o 
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